Oxford publications started up a sort of revolution on how printed books are accessed online.
Most other publishers put the exact same book, in a single PDF or Epub format, online for sale. Oxford makes an important change that seems to start a revolution on how we consume books online. In Oxford’s system, each of the chapters of the books stand by themselves as published articles. Each of the chapters of the collection gets their own DOI that they can be read, downloaded or referred independently of the main book.
Look at this video how it works.
Now, we are in a position to have the cake and eat it at the same time. The old conflicts on whether to keep books broke into their chapters and sections (as such a system facilitates searching and discovery on each of the chapters), or, keep it together to be able to see the work as a whole immediately disappears. We have both the whole and the individuals at the same time.
So, I have been wondering on how to mirror that system in Bookends. I experimented on how each of these independent chapters could be managed. Bookends has a mechanism to manage Chapters separately; while still linked to the main book. Bookends is such a well-thought application: each of the chapters are able to live by themselves just exactly like they are presented in Oxford Scholarship Online. I am so impressed. I haven’t seen any other offline reference manager that is able to manage chapters like Bookends (Oxford).
The more I use each of the features, the more appreciate how well-designed Bookends is.
For me, I used to split PDF books into specific page ranges (page 1-50; 51-100 etc) just to keep the large pdf books easier for my searching tools like Foxtrot. I have already explained the system before.
Now, with Oxford Scholarship online and Bookends, I don’t need to split. I simply download each of the chapters and attach them as chapters into a single reference entry in Bookends. The pdf files of each of the chapters are attached to their corresponding entries. It is much better system because I won’t have duplication of information. I only hope that all other publishers offer books in the same way to the Oxford Scholarship online.
Now, I am updating my experience with the Bookends.
The good news: the latest version of Bookends (12.7.7) has solved one of the major complains I had on the application. That is: it can now extract references from a plethora of sources that the source of extraction is no more a problem.
In addition, I learned in the course of the previous months that the right method of finding references of PDF books is to use the ISBN associated with the books. Once you write the ISBN of the book in the ISBN field, Bookends happily can download all the reference data from Amazon using its Autofill feature. The Autofill feature is a super-feature. One day, I put about 400 PDF articles collected over the years into Bookends watch folder; all of them have their DOIs printed in the first pages of the articles. It was just magic to see all the PDF files find their references filled automatically in a couple of minutes.
I also leaned that Bookends is much potent application than Sente when it comes to managing references. The tools embedded into it are unbelievably rich. It has organizational tools like: smart folders which support REGEX, static folders, labelling (color coding). It has a fully configurable Format Manager which enables the end user to import or export; rename the references in endless ways. The Format Manager in Bookends is the greatest feature I have ever seen in any reference manager. It is a dream come true. It is a liberating feature. I cannot say enough about it.
Bookends has other tools under Global Change. Finder replace that works across the whole library; batch changing of reference types, batch inserting data..and, other many types of manipulation tools.
Attachment handling and file renaming is superb in Bookends. The best part is: files are managed very transparently. You can explicitly put your files in a Dropbox folder without any hassle: while still they are attached to their references.
The Duplicate Finder tool embedded into Bookends is the best in the class. Jabref is great for finding duplicates. But it cannot reach the complexity and elegance of the duplicate finder in Bookends. You will never miss a duplicate with it.
If you are into Latex, it is also one of the most Bib friendly non-bib reference manager. It can assign unique Bibtex keys: and, the Format Manager can be manipulated to export in any of the Bibtex formats (Bibtex or BibLatex). You can also manipulate your format to export distinct (unique) bibtex fields. You don’t even need to export the reference to get your bibliography to work with Latex. You can make Bookends to work with your Latex file directly.
Bookends has AppleScript dictionary. That again opens a world for who are into the scripting.
Integration with other super applications: I have never seen any reference manager as flexible as Bookends (I admit, Zotero could be even more flexible: I just don’t like that app; never tried it seriously.). For me, the fact that Bookends works well with Devonthink and Tinderbox is the best part of the story. Bookends is hand in glove with both Devonthink and Tinderbox. You can export and import in both directions; you can even directly sync them using some scripts (all the three are scriptable). Combining the three power tools is the nirvana for the knowledge worker. The world has never been greater.
The only feature I am still missing from Sente is the reading and annotating capabilities of Sente. The reading experience in Bookends is nowhere closer to Sente. Otherwise, as I am more using Bookends more, I am getting more surprises how a reference manager could be so rich and so capable. In an ideal world, BE would incorporate the annotation tools of Sente.
Markdown is a language built for plain texts. The biggest weakness of plain texts is they can not hold images in them. To complement this fundamental weakness of plain texts, I have developed a system that works between Hazel, Dropbox and Keyboard maestro. The idea is simple. Create a permanent folder in Dropbox that you will maintain for the rest of your life. Whatever text you are writing in, whatever application you are using, always save and point to that specific folder. My folder lives in Dropbox. I call it simply Images. All of the pictures (images) that are part of my text notes are stored in this folder. Most of these images are made by snapshotting from the pdf files and online sources. For that matter, I made my mac to save all the screen-shoots to automatically save in that folder. ok, let me write it like in steps:
Make a folder in Dropbox: call it Images
Make your mac to save the screen-shots in Images. Follow the steps in here to accomplish it
Make a hazel rule to rename the screen-shots to a sequence of numbers (or some other pattern you like)
Embed an applescript inside Hazel that will copy the file name of the image to clipboard
Look at the rule I made in Hazel: first only the rule;
then with the script:
Finally, use a Keyboard maestro macro to get the location of the image as well as the file name.
That is it. What you need is just to snap the image from the PDF then, write “ppic” in your plaintext file. A link to your image will be inserted; and any markdown previewer (Marked for example) include the image in the preview.
Since I want to follow up informations on the internet on a few applications that I am interested in, I have setup google alerts for tracking blog posts and articles into my email inbox. Under my Devonthink tag, today I get this small visual workflow in a website called Pinterest.
I have never visited Pinterest before; but the visual illustration looks beautiful. There is no explanation on how to build the workflow in the visual maps; but the illustration is elegant, something I have been planning to design. Since this is the workflow what I am already using it for the last year, it seems good idea to put how I put these different apps to work together to have the “virtually perfect” kind of workflow for my research (phd dissertation, I am starting soon). I have already written short articles in my previous posts on some of the connections I made between these four majestic apps. In this extended post, I will demonstrate how I developed my workflow using Sente, Devonthink, Scrivener, nvALT, xMind, Sublime Text and ultimately Latex. Hazel, the Automator, Dropbox and Keyboard Maestro are the core glues of the workflow. I will spell out how each app works together with the other applications to great a coherent and elegant workflow.
Now, have a loot at a pictorial overview of the workflow we will have by the end of this series.
In the next few series, I will try to explain each step of the workflow; how I develop the connections and how the tools chosen talk to each other to build a solid workflow. (I didn’t represent Hazel in this drawing mainly because the tasks of Hazel. The role of Hazel will be clear by the end of the post)
Let me start from the app I use to gather resources for research: Sente.
For me, the most important organization burden is lifted by Sente. Sente has four crucial features which are the life and soul of my workflow: Targeted browsing, File renaming, QuickTags and Status. I will explain how I use each of these features to download, store, rename and organize my PDF files; then, how I will incorporate the organized PDF into the Devonthink hemisphere using Hazel as a glue.
I am not going to explain how to do all the importing and referencing process in Sente. That is left for the user manual; my task here is to show how to use what I call above the crucial features and getting things done.
Let me start from setting up the Sente library:
## File naming
The library is setup to store PDF attachments inside the Sente bundle. Setting up the library inside the bundle is very important for syncing the library to iPad via the Sente server.
The attachments will also be named as:
[First author Last name] [Year of publication] [Title of publication]
The file naming is important because I find some of the PDF files hard to read inside Sente; hence, I have to open them in acrobat. If you have the files properly named based on the author and title, getting the file is just a matter of second, specially if you are using Alfred.
## Targeted browsing
After you setup your library, the next step is to search files and download or import them into your sente library. There are two ways of getting your PDF files into Sente library; both of which support of-the cuff-setting up the reference of the file. The first method is directly downloading from the internet. Sente has this wonderful feature called targeted browsing. The main advantage of the targeted browsing is you have a choice of downloading bibliography information from a plethora of websites; you are not limited to Google Scholar or MedPub (the main weakness of Mendeley, by the way is absence of such a choice; it can download only from Scholar and medPub). Even if Google scholar is one of the greatest data sources on the internet, the data you retrieve from it are usually incomplete. Many people like MedPub. But, for my field, MedPub is irrelevant. Therefore, for articles, I havn’t found any better source than Google Scholar. To get both the reference and the PDF file from Google scholar to your library, what you do is first import the reference information into your library by clicking the red button in scholar website; and then, download the related PDF file. I am sure you know how to do this; I don’t need to explain it in depth.
The second approach is to have the PDF file in your disk; and then drag it or import it into your library. Sente will present you a window to add reference information to your PDF file. At this point, what I usually do is: highlight the title of the PDF file and take the title to my favorite search engines. For research articles, there is no better choice than Scholar.
As for books, thanks for their ISBN numbers, there are a lot of choices; WorldCat being one of the most popular. I used to retrieve the data for the books from WorldCat for a while. But, after some time, I leaned that it sometimes confuses Affiliations metadata with Author. Therefore, I have been looking for alternative sources for retrieving bibliography information for books. Google Books is quite good; but Sente Targeted browsing seems to have some kind of difficulty to retrieve data from google books; takes longer time. Finally, , to my surprise, I discovered the library of Stanford has the cleanest data; and Sente is very happy about it.
The template you develop to modify your targeted browsing in Sente is called Autolink Templates. Here is how I setup my Autolink Template:
Quicktags: are the tools for organizing your research resources into groups. I have three major classes of Quicktags:
a) the Class: this is the class of quicktags that I assign to the PDF’s inherent classes. I assign these tags to classify the paper into the basic inherent classes of my field: Linguistics. Linguistics has many sub-branches if study; and sub-topics of research. Therefore, whenever I download a PDF paper, I assign these classes into the paper so that I can easily search and look at whenever I am looking at certain sub-topics. I for example use tags like Syntax, Semantics, Pragmatics, Phonology, plus sub-topics such as VPs, PP, RC, DP under Syntax which what they are. I also have hierarchies of tags for the families of languages that I am interested in.
b) the Project: this is a group of tags that I assign to papers on project basis. The projects are usually transient tasks that I plan, finish and move on to the next project. They could be part of the specific Class; they can also run across many classes. I assign these transient tags to the papers I am downloading, or on those which are already in my library. I search down my library, google scholar and may other source to combine all the resources to finish under one project using these Project tags.
c) the third group of tags is what I call meta tags. They are organizational tags. Whenever print a PDF file, I assign a tag xPrint; whenever I am reading the paper in Acrobat reader, I assign a tag called xAcrobat; or, finished reading the PDF and exporting the annotations of the PDF, mark it xExport.
The Meta tags are supporters while Project tags are brothers of the Statuses, which I will explain in a moment.
I basically use Statuses are meta-tags and to track the progress of projects. As you can see from the following snapshot, I have about 12 Statuses that I assign to my PDF files:
– To be read next: is for example a status that I assign to a paper that I want to read just immediately after I finish reading the current paper.
Must read: is another status for a paper need to be read by hook or crook before I finish my PhD; a paper that I believe can offer a significant and profound insight to my research.
Repelling is on the negative side: a paper hard to read; or written in a bad language; the point is: I am dropping that paper; and might delete it from my library completely.
I have been watching the developments of Docear for a long time. I like the whole idea of research suite where you drop everything related with your research; and get things done without much distraction. There are a few applications which promise to give such a functionality both in the windows and Mac. Docear seems one of the most promising of these apps, specially given that the suite is an open source, any university/huge project pick it up and pushing it to perfection. The other advantage of docear is its integration of one of the best open source reference managers in existence. The idea of integrating mind-mapping into the research is also good. But, there is one serious issue that makes the application unusable to me for a long time; its poor capabilities to directly edit files. Since it is build on top of a mind-mapping application (Freeplane), editing even the most basic TXT files is currently impossible. If you want to write a text, you have to write it on the nodes of the maps and export it finally. That is the idea. But, personally I hate exporting and importing. If an app can index a folder from the explorer (Finder), what is the point of exporting and importing. Why couldn’t they give the chance for us to directly edit our files as they are stored in their folder, as Devonthink does, without the hassle of exporting and importing? To make the point clear: I have more than a thousand notes saved in TXT format in my dropbox folder. I can directly index that folder into Docear, which is great. But, I can not open these text files inside the application (I have to run another application to view them) which is unfortunately debilitating task for organizing the notes and finally write a draft. The developer are probably thinking about short texts when they develop Docear. But, a serious writing is not about few pages; rather hundreds and thousands of pages of text. Write a hundreds of paragraphs, let alone pages on a node is a crazy idea in the first place. Even for a short text, mind-nodes are very ugly. If docear has to be a true research suite, it has get a good internal text editor. That is mandator. Until this problem of text editing is solved, I find Docear useless to my workflow. I hope the developers will incorporate a good text editor into the app soon, and we will enjoy the app.
nvALT is one great fast note writing app. After collecting your short notes for a long time into nvALT, now, it is time to use them in your writing. you have two choices:
importing: importing the notes saved in nvALT into scrivener. this is a simple method. The problems is, any of the changes you made in Scrivener will not be saved back into your nvALT notes. As a principle, I personally don’t like importing because all the notes I saved in plaintext in my dropbox folder will be eaten up by a proprietary file format…the reason I don’t like Evernote and confused about Tinderbox.
syncing: This is better method for working in Scrivener directly updates the notes in nvAlT and vise-versa. The best part, you are still maintaining your clean plaintext files in your dropbox folder. Suddenly you decide not to use Scrivener, well, everything is in you hard; open your texts in another editor. Therefore, my agenda is to show you a small trick to make the two best text editors work flawlessly together using Scrivener’s FolderSync feature.
First, store your notes in nvALT, as a plain text file; in a folder in dropbox (finder). I call the folder nvALTnotes.
Now, start up a new blank project in Scrivener. Before you write anything in it, go to File menu and Sync. Create a blank folder in Dropbox called Scrives and choose that folder in the sync dialogue.
Now, open and look at the Scrives folder in dropbox. Scrivener has created two folders: Draft and Notes
Delete the Notes folder
Go to http://www.zibity.com/macdropany and install the small free app: Macdropany. What does the app do is create a symbolic link from your Finder to your dropbox. you can also do the symbolic link via Terminal if you are technically inclined. i am not. i go for the small app.
Now, go to nvALTnotes folder–>right click–>Services–>Sync via MacDropAny
Choose Dropbox from the list of cloud services
Now, when the dialogue asks you to choose a folder in Dropbox, choose Scrives folder that you created above
now, when the app prompts you to rename the folder, name is Notes (this is very important; otherwise, Scrivener will not sync)
Now, all your note files in nvALTnotes folder will be available inside Scrivener; and any changes you made inside Scrivener will be reflected in nvALT.
DEVONagent is a specialized searching tool, designed to provide more accurate results than the regular search engines. I have been trying it for a few days now. So far, my experience is, the search results are not better or more accurate than regular Google search. I have tried a few queries using the Web Deepest field in DEVONagent. In many instances, the search results are even weaker than that of Google, in my view. Since the tools of DEVONagent seems to work by analyzing the keywords of web pages, they are generally deluded by some wiki pages which put a lot of keywords with little actual content. Google has a way of killing these kinds of sites which put too much key works (tags) without actual valid contents, as it receives feedback from the users’ experience.
There is a small window of opportunity to make the two applications work together.The opportunity comes from the Sync feature of Scrivener.
Even if this feature oppens the oportunity, the fact that it has limited capability to sync files complicates the relationship bewteen the two applications.
The weakness of the Sync feature is; it doesn’t support multiple folders. This means that, your heirarchical organizations based of authors or topic you use inside Scrivener Binder ( Research or Draft folder) will not be available in the Sync folder. The sync folder will have only 2 folders; one for the Draft and another called Note for the rest of the files ( all the files inside the Research binder). All the items, in whatever heirarchy you put them insider the Research Binder will be put into a single flat folder. This makes things hard to identify which note belongs to which group (folder) of the Binder. In the current system of Sync, the feature is almost useless, specially if you have built complex system inside the Research Binder. Assume that you have collected your materials and grouped them under an author name inside Research Binder. Say, you have collected 50 notes, 5 PDFs and 10 webclipings under authorX. You also have 5 notes, 2 pdf and 5 clipings in AuthorY. Each of the authors have their own binder (folder) insider the Reacher binder. When you syn, all the notes, cliping and pds will mix insider a single folder called Note, insider finder. You can not distinguis which note belongs to which author then.
In ability to maintain the folder (binder) heirarchies is the main issue of the syn in Scrivener.
A simple strategy is to tag the files before you import them to Scrivener. Tag them in the Finder and import them to Scrivener. The Tag functions to map the folder structure of the files in Finder and Deveonthink.
Tag them by AuthorX–>import them to Scrivener into separate folders–> sync them–> index them in Devontink.
I have already started writing about the great research tool, Mendeley Desktop. I believe, mendeley is one of the mandatory tools every academician need to have. Many people are using it for many things. As to me, however, its main virtue is the ability to organize the actual PDF files in a brilliant manner. In this post, though, I am going to tell you why you need to avoid reading and annotating PDF files inside Mendeley itself.
If you are familiar with the fast and efficient PDF readers as Foxit and PDF-exchange, you will face too many constraints with Mendeley’s internal PDF reader, which I found to be unbearable. Of course, you can read, annotate and write notes inside mendeley. But, the main downside of Mendeley’s internal PDF reader is the fact that your annotations will be saved in separate folder. Mendeley has a system called database where it saves information about the PDF files. That database is in a different folder from the actual PDF files. Hence, if you open your Mendeley annotated PDF files in another PDF reader, you will not get the annotations. This is bad. I want my PDFs annotated wherever I open them, whenever I want.
Mendeley team has tried to alleviate the problem by adding a feature to export the annotations of the PDFs. But, I found this to be a laborious task. Should I open and export the annotations of each and every file every time I want to see my annotations in another software? no, I will not do it. So, if you are like me, the best approach is to manage your files inside Mendeley and read them using more potent PDf readers as Foxit. Your annotations and notes will be saved embedded inside the PDF files that you don’t have to worry opening them in another software. You will enjoy your annotations to the end of time (unless you want to remove them of course) wherever you go, which ever software you use. So, to open the files organized inside Mendeley with external readers, you have to right clicking the file and choose “Open file externally”. Your default reader will be fired. Voila!
I don’t know that people still check out this post. I wrote this in 2012. I want to update my latest experiences. I have given up with mendeley. I am now encouraging people to move away from this applicattion because the reference data it downloads is complete junk. The user has no option to download data from Woldcat or some other better source (national or international libraries; publishers like Jstor etc). I am now using am amazing reference manager called Bookends. Since I moved to Bookends, I am able to maintain a bigger, and clearer reference data.
Zotero is also a great tool. For the peopl who use Latex, Jabref recently has grown extremely powerful reference manager. It has gone a lot of transformations. I highly encourage you to check out Jabref. Other great tool in the Windows is an application called Qiqqa. Citavi is also ok. You can check out this post on the comparison of the other reference mangers.