Is anyone else having this problem with importing their files?
Liity LibraryThingin jäseneksi, niin voit kirjoittaa viestin.
Tämä viestiketju on "uinuva" —viimeisin viesti on vanhempi kuin 90 päivää. Ryhmä "virkoaa", kun lähetät vastauksen.
Is that supposed to happen? Does that mean it's working? I feel like it's some kind of joke... one that leaves me utterly baffled.
Details for the curious:
I use Shelfari and LibraryThing for very different purposes - LibraryThing is a catalog of my entire library, whereas Shelfari/Goodreads merely holds reviews of books I've read, which I may not actually own - so I decided I would only import the books that I've written reviews for. I got my library .CSV file and deleted the hundreds of books I've read but never reviewed, then saved that file. After multiple attempts, I did actually save the file in the exact same way it was originally stored, with the same title and in the same location. I didn't delete any columns, just rows.
ETA: I'll also check on the progress of your import, and let you know if you'll need to try it again.
That's undoubtedly an import problem. It's possible that there was a hiccup with Shelfari's export (you can open the exported .csv file, if you want, and see whether the duplicates are present there), or it's possible that the error is on LT's end; if the Shelfari import is something they put together in a hurry, it's probably a problem on LT's end. If you want to get rid of the duplicates, you can go to Power Edit (the little lightning-bolt icon when you're looking at your catalog), choose "Miscellaneous", and click on "Select all ISBN duplicates in your catalog". You'll need to pick which duplicate in each case to get rid of. Alternatively, if you haven't done any editing on your catalog here on LT, you can delete all the books and do the import again once the staff have ironed out the bugs.
I'm sorry that your first experience with LT has been so negative.
In our recent import queue, I see two imported files from you, one on the 14th (3,320 total books) and one on the 17th (3,398 total books). Looking at your library, it appears that your duplicates are books that overlapped between those two files. For example, of your two copies of Acorna's Quest (here and here), one was added on the 14th, and one on the 17th.
You can use the Power Edit feature (the little yellow lightning bolt button at the top of the Your Books page) to bulk select and edit books (including deleting). Sort your books by Entry date (click on the title of the column to sort), and you can pretty quickly select books from a single import for editing/deletion.
Again, I'm sorry for the hassle. Feel free to email me if there's anything else I can do to help (email@example.com).
I messaged you directly with this note as well, to make sure it got to you ASAP.
The first name only ones are fairly easy to combine, but the others are a lot harder.
This is a concern. I have Ammar looking at it.
@caallas probably had the fewest, and I was able to find matches for everything. But apparently a lot came through twice. See the PMs for work numbers of problematic entries.
Its all very odd. Shelfari sent me my file and I checked it out and was delighted that it completely agreed with my shelfari shelf,correct to the last book on my shelf.,which was a relief. So I didnt expect such a muddle in the transfer to LT. Never mind,I'll just leave it a while. The great thing is that I used to tag almost all author ,so there are my tags tucked under the ''cloud''section on here,so I have all my data there,carefully and conveniently arranged in my familiar way. I am extremely happy about that.:0)For instance,I was delighted to be able to look at the covers of my 45 Anne McCaffreys,everything at my fingertips.So the issue with the shelf isnt so vital when I feel the urge to check what I have by a particular author or in a genre.
Thanks for your patience! I know LT's staff are hard at work on the import issue (since the Shelfari import is probably one they put together on short notice), but it must be enormously frustrating to have all your nice data so messed up.
>6 dustydigger: I have tried importing your latest Shelfari import and looked out for duplicates but did not find any. Therefore, it may be like >8 lorannen: said, a merge between your two import files. Also note, that in the import questions page, one of the sections is dedicated to importing duplicates and the 'Import duplicates again' option may have been unintentionally selected.
For now, I plan to sift through Shelfari imports and look for errors as described by >11 MarthaJeanne: to make sure that importing those same files do not cause the errors anew.
I did look through Marcellas catalog. The only thing I noticed off was some of the authors were named 'False'.
So, I downloaded the file used by Marcella and had a look. It turns out that the value for some of the entries is the text 'False'.
Im not sure why Shelfari would export some of the records that way, but at this point, all we can do is try to detect the value 'False' and throw it out. Im not sure timspalding wants to take that route.
I'm happy LT got so much imported anyway, as no other site managed to import more than 15% of my books. And I'm grateful that you are taking the time and effort to look into these problems - a welcome change from what I'm used to at Shelfari and Goodreads.
I fully agree with everything Marcella says. I have many hundreds of partial authors. I did make a start on editing them,have done about 30,but if you think you will be able to make an improvement in the situation,I will leave them for now.Its fiddly time consuming work,
If not,I am going to have to dedicate my Sunday afternoons to editing.Havent dared count just how many blank covers I have which will need editing,but it definitely runs into hundreds.
I really appreciate your hard work. Fingers crossed things will improve
Actually, currently working on the partial author problem :-)
I will keep this post updated.
Thank you for your patience.
For example https://www.librarything.com/work/17074362/book/125774571
Not autocombined because of faulty author import, but if you go to the editions page (lower left), the computer suggests the correct work. Your entry will still be wrong, but the work information will all be there for you. In this case with 107 covers.
BTW The computer often makes bad suggestions, so it is a good idea to think while combining.
Update: a resolution to the partial author problem has been made.
It turns out that shelfari exports included the main authors again in the additional authors section in last-first form.
This meant there was an extra comma and it was throwing our code off.
I have used your import file and compared my 'fixed' data with your catalog and the single-author problem has been resolved.
Do let me know if you notice anything else off.
>26 .Monkey.: Thanks for the heads up, will take a look at this shortly.
what a lot of trouble from one little comma!My editing will go much faster now,as with the correct authors I only have the covers to change.Only about 130 more books to edit.Its a pity that I have so many old books with no covers available.Should just read new books that hundreds of people have uploaded pictures for! lol
I really appreciate your help with this glitchy import. Still,its an awful lot better than my export to Goodreads,only 1500 out of 3600 made it through,after 3 attempts.I have given up with them really. Once my books are fully sorted here,backed up with Leafmarks,it will be bye-bye to GR!
Now, all the dates from the 'Date Read' column will be imported from your Shelfari file.
Taking a look at your import file.
Marcella1717's question is also mine - do I chuck what I have and start again before I have done too much editing here?
Now, Im not making any promises, but I hope to get the green light from him tomorrow to start implementing this change. It depends on time constraints and priorities.
I will keep you updated though.
>38 timspalding: The script I am working on will only fix the author issue. Although, now that I think of it, it should be doable(and easier) to work in a fix for dates as well. Ill see what happens(read: whatever Tim tells me to do :) )
Dates were already fixed, but not retroactively, right?
I imported my Shelfari library both to Leafmarks and to LibraryThing. The Leafmarks import worked perfectly so I don't think it's a problem with the library itself. I've emailed the info desk to ask if I should delete everything (if so, how?) and start over, or whether it can be fixed somehow. I'm sure I didn't initiate the process twice, but I'd have thought duplicate books would be flagged or ignored in any case.
When importing books, there's a checkbox for ignoring duplicate books. From the couple of imports that this has happened to, my guess is that it's not checked by default. You may want to doublecheck that it is before you try importing again.
Much appreciate any and all help!
I'll let Martha Jean address you concerns...
I'm a shelfari refugee....hence, haven't a clue.
A few interesting things.....
Only a few of my reviews came across....I have been entering manually.
Those that did were interrupted like this...... A touching story of small town America, set in Gilead, Texas 1934
I was surprised to find this book written by Sandra Brown (of NY Times bestseller
David Rainwater profoundly touched the lives of everyone he met.
When I called all the views for this book to compare, mine looked like this....unreadable.
I've since been manually either overriding this type or hand entering ones not transferred.
I'm slowly collating or at least trying to gather data from other sources
I had an issue with book covers not coming over but that seems to be resolved.
Ammar has made some changes to the import system as recently as this morning. I'm going to try your original import file in one of my test accounts to see how it goes. I'll post here again once I have some results to share with you.
This is what it looked like I called up a review that had transferred in
......sorry it won't duplicate now
Also, there was also no distinction of separate lines.
You may not find any difficulties since I'm almost done.
Very few of my reviews came across initially but that was good since they required correction.
Thanks for all the help
My covers weren't showing wfter import so I deleted and will retry in the AM.
I hope all my LT info was also on Shelfari - pretty sure 90% or more was on both sites
If the book only is shown as having one or two members, there is a good chance that it can be combined. If you can't get the cover you want that way, you can always upload a cover. To change your cover, go to the book page and click on either Change cover in the left hand menu or on the cover images on the right hand of the page.
BTW, experienced LT users avoid Amazon covers. They are usually less sharp than member covers, but more important, if the publisher puts a new cover on the book, your cover picture will change.
>56 nospi: Just to add on to what >57 MarthaJeanne: said: I don't think so. As a side note, a recent modification has been made to the import process concerning non-ISBN records which have a valid ASIN that is also an ISBN, that ASIN is added as the ISBN also.
>58 middleman66: Currently looking. Will keep you updated.
Do note, that there have been various fixes in field mapping, so there should be a difference since the last time you imported.
Also, shelves are importing, but they are importing to tags, rather than collections. Depending on how the shelf is worded, it makes sense to either have it map to collections or tags. Should we change the mapping to collections instead of tags timspalding?
Regarding ASINs and ISBNs, if the ASIN is an ISBN, it will import through both fields, even if that record does not have an ISBN.
However, if the ASIN is not an ISBN, like B000BT3GGA, only the ASIN field will be filled.
I would try first importing a subset of the file to see how it gauges. Do let me know if you experience any other issues.
Thanks for your time.
Regarding importing to tags, we only look at the 'Bookshelves' column and convert those to tags. Other columns in Shelfari files such as 'Owned' or 'Wishlist' are disregarded. If you want a book to import into a tag of 'wishlist' make sure that value is in the 'Bookshelves' column.
To sort by author, and within each author by title, click first on title, then on author.
I also find date read a useful sort. Total members (only available with the icon) helps find books that need combining.
I had one issue in that it seems my library came over into my Kindle Unlimited Collection. Could someone advise the best way to bulk edit or otherwise address this?
Is there anything I should do?
Where is the appropriate place to report it?
Thanks for any assistance/direction
Ammar can look at what the API is getting from Amazon tomorrow. I suspect it's coming up first for it too, which is stupid.
When I go search for 0439023483 against three sources(Amazon, Overcat, Library of Congress), all the results I get are correct. None of them are for '1000 New Helpful Hints'.
Also, the API seems fine. I have tracked down that specific import record and imported it into my catalog and was added correctly.
Possibly a hiccup with Amazon search?
2/8/16, 9:22:20 AM Ammar Abu-Yasein: :) I was using 'Amazon.ca books, music and movies'
2/8/16, 9:22:32 AM Ammar Abu-Yasein: 'Amazon.com books' does it, thanks
Ok, so the Amazon API was indeed returning '1000 New Helpful Hints' in its results.
It is also found in search results at the Amazon website itself: http://www.amazon.com/s/ref=nb_sb_noss?url=search-alias%3Daps&field-keywords...
I made a specific fix for that ISBN. If that record is imported again, it will import 'The Hunger Games (The Hunger Games, Book 1)'.
Thanks for reporting nospi!
the error message is: Insert into queue_collections(qc_q_id,qc_collection) Values (,281061)
You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right sytax to use near ‘281061)’ at line4 –fatal error (1)
I have 3663 books, 37 dups, 847 without ISBN. I picked Your Library for Collections, sync with duplicates, and import those books without ISBN.
I then tried to reimport my partial list that was already sucessful and I go the same error.
>80 middleman66: Thank you for reporting! This was an oversight on my part related to mapping Shelfari fields to collections and merging collections. It is fixed now and you should be able to sync collections without a problem.
*read: I was actually wide awake :-)
To explain a bit better to those new to LT.
This book was imported with the wrong info because of an ISBN problem. If you have a copy of that work, you probably own Hunger Games and not 1000 Helpful Hints.
If you really do have the hints, a small change in the title or a correction to the ISBN will make it possible to move it where it belongs. I can help, or post in the combiners group.
If you own Hunger Games you can either
1) Get your book out and correct all the info in the existing entry.
2) If you have no personal info in your entry, delete it and reenter, maybe from a library source like OverCat, although it should enter properly from Amazon now.
3) If you have a review, reading dates, etc. Reenter the book, move any such data, and then remove the wrong entry. If you put a unique tag on both, you can easily get a catalogue page with just those two books. I would probably open them in separate tabs.
In all these cases, it would be a good idea to check that your entry is not only correct itself, but that it is in the right work. Go to the main work page. There is a box labeled 'Your book information'. The top line shows your title and author. The bottom line shows the work title and author. They should be similar. If you chose 1) they probably won't be.
If not, it should be possible to go to the editions page and separate your copy out and then combine it properly. If you need help, message me or post in the combiners group.
http://www.librarything.com/topic/219165 is a special topic in Combiners for this problem.
Posting since I'm not sure if this is a known issue already.
For 2), yes, it should import correctly from Amazon now.
Do let me know if there's anything else I can do or if any other works seem off.
I took a look at those two profiles. For one user, our historical data suggests the file was uploaded multiple times. For the other user, however, it is clear this was a problem via our import system itself.
Unfortunately, the reason is not crystal clear. I performed an all-around import system test yesterday and did not experience any duplicate imports.
Nevertheless, this issue needs attention and I am officially putting it on my plate to take a look at next week.
We are currently doing a major over-haul of the import system which will allow us to handle larger files. Once that is taken care of, I can start on this next.
Thank you for reporting!
Thanks for trying to sort it out on Amazons end!
Anyway, March 1 and then problems are bugs.
Ok, so over this past week and weekend we've had quite a few large imports(ranging between 10,000 and 27,000) records.
Ive checked and all of them went through fine except yours(what luck huh ;-) ). I suspect an error on our end is not processing your file correctly.
Therefore, going to take a look at your file specifically and Ill keep you updated.
Could you give it a shot yourself?
I will be monitoring records to look for your import.
However, looking at your catalog, that is not the case.
Did you remove any of the books after they imported?
ETA: and it turns out that all 5 of the new ones that imported are duplicates -
>104 Booklover889: I have fixed some import errors since and retried your file yesterday with the same options you tried when importing.
The file imported successfully for my account.
I have signed in as you and am currently importing the file with the same settings you had. I am doing in this in order to monitor the import and I will keep you updated.
Thank you for your patience!
I really appreciate all your efforts to get this to work for me - thanks!
ETA: turns out more of the tags are there than I thought - when I look at the tag page (from "all collections") the numbers seem very low (eg, 415 w/ the tag "read") but when I click on the tag to see those books, I get 1011 books in the list. Some of those have a blank in the tag field in the list view, but when I look at the book page the tags are there. So maybe the import hasn't quite finished yet?
>108 dayspring777: Thanks for notifying us. Let me take a look.
There are indeed some weird comma issues as my excel editor itself was displaying the data in an incomplete manner. However, I went through several of your books with commas in the 'private notes' field and checked them in your catalog. The notes imported fine.
Do you have any specific records/examples in which the data imported wrong whether or not it was due to a comma or special character?
Example of dates, tags, and random things from notes as well as true/false entries:
After beginning to page through, this seems to be the first instance:
The tag /2013\ shows as /2013" with the title's author, true, false, an isbn, the shelfari book id number, and the title/author of another book all showing in tags. On the other work on that page with a tag using my /2015\ showing as /2015 I have tags that fall after that one and the rest of the tags and entry following are normal.
My tags have among other things titles, authors, aisn's, other strings of numbers, and year/month/day dates from the file's date read or date added. (I already had some numbers in tags...1 through 900-something as well as four digit years. Anything bigger is not supposed to be there.)
Can I delete everything (all books and the mess with them) added to my profile and re-import? As I said, I would like to fix my comma problem and would like to know any other character that makes problems, as I noticed the slash does not show at the end of a tag ("/2015\" often shows as "/2015").
Will a + or a - have any affect on tags?
Thank you very much for your help!
>113 dayspring777: sorry for my late response. I was able to take a closer look at your import file today. There is definitely a problem with importing tags that have the '\' and '+' characters('-' seems to import fine).
Moreover, Im a little confused on the number of actual records in the file. My excel editor suggests around 3300 while there are a good amount of empty rows(rows with an obscure title such as R.1). My question to you, are those actual books/records or is the excel parser messing up and displaying a greater number of records than there actually are?
Im going to try and see if there is a feasible solution for the '+' and '\' characters(do let me know if there are any other special characters you use).
Sometimes, when there is HTML encoding, '+' translates to a space. As for '\', that is used to escape other characters.
So this might have to with what is going on if those characters are not escaped properly.
I have a .csv from my years on Shelfari, and I also added a great many more books and reviews and comments when I went to Leafmarks at the beginning of the year. So I'd like to import from Leafmarks directly if that's at all possible.
The site directions for exporting are a bit wonky, and I do have a .tsv file if that would help.
Thank you for helping me know I am in capable hands with all the tech savvy people jumping onto problems at all hours of the day and night and in between!
Please keep in mind that I don't know if this is the correct answer though... :)