Author |
Message |
Registered: May 19, 2007 | Reputation: | Posts: 5,715 |
| Posted: | | | | Quoting mediadogg: Quote: Good point about Cast vs. Crew. would you prefer an attribute, or grouping? If it is no effort a flag would be fine... | | | Complete list of Common Names • A good point for starting with Headshots (and v11.1) |
|
Registered: March 18, 2007 | Reputation: | Posts: 6,463 |
| Posted: | | | | Quoting AiAustria: Quote: Quoting mediadogg:
Quote: Good point about Cast vs. Crew. would you prefer an attribute, or grouping? If it is no effort a flag would be fine... So you will prefer: (1) <Credit> <CreditType>Crew</CreditType> ... </Credit> or (2) <Credit type="crew"> ... </Credit> or (3) <CastCredits> <Credit></<Credit> ... </CastCredits> <CrewCredits> <Credit></Credit> .... </CrewCredits> or (4) <CastCredit> ... </CastCredit> .... <CrewCredit> ... </CrewCredit> Or, some combination? Not much difference in the work effort. Just formatting. | | | Thanks for your support. Free Plugins available here. Advanced plugins available here. Hey, new product!!! BDPFrog. |
|
Registered: May 19, 2007 | Reputation: | Posts: 5,715 |
| |
Registered: March 18, 2007 | Reputation: | Posts: 6,463 |
| Posted: | | | | Ok, I did find that I was forcing lower case, so I fixed that, and the missing closing bracket. I also added the credit type flag and reworked my divider handling. I tested a few profiles by relaxing the actor match and pulled the entire cast / crew XML and checked against the downloaded profiles. I think I've got it. Here is a sample: Quote:
<?xml version="1.0" encoding="ISO-8859-1"?> <!-- Credit Information Export (c) 2019 mediadogg Software --> <CLTInfo> <Credit type="cast"> <Firstname>Will</Firstname> <Middlename/> <Lastname>Wallace</Lastname> <Creditas/> <Episode/> <Groupname/> <ProfileID>723952078414</ProfileID> <ProfileIDBase>723952078414</ProfileIDBase> <Locality>0</Locality> <Localitystring>United States</Localitystring> <Title>Rock Slyde Private Eye</Title> <Originaltitle/> <Productionyear>2009</Productionyear> <Rolename>Steve Bookerson</Rolename> <Puppeteer>False</Puppeteer> <Uncredited>False</Uncredited> <Voice>False</Voice> </Credit> <Credit type="crew"> <Firstname>Will</Firstname> <Middlename/> <Lastname>Wallace</Lastname> <Creditas/> <Episode/> <Groupname/> <ProfileID>723952078414</ProfileID> <ProfileIDBase>723952078414</ProfileIDBase> <Locality>0</Locality> <Localitystring>United States</Localitystring> <Title>Rock Slyde Private Eye</Title> <Originaltitle/> <Productionyear>2009</Productionyear> <Rolename>Producer</Rolename> <Puppeteer>False</Puppeteer> <Uncredited>False</Uncredited> <Voice>False</Voice> </Credit> </CLTInfo>
This was cut and pasted from MS Edge, so I guess it changes the codepage. My original is the expected 1252 that Profiler uses. Still working on the scraping. Not to be presumptuous, but Gunnar, how does that XML format look to you, should we be so lucky to have you do the advanced stuff? I am thinking you might benefit from a bit more structure, such as <DVD></DVD> elements? | | | Thanks for your support. Free Plugins available here. Advanced plugins available here. Hey, new product!!! BDPFrog. | | | Last edited: by mediadogg |
|
Registered: March 18, 2007 | Reputation: | Posts: 6,463 |
| Posted: | | | | Hot Dog! Figured out the scraping. Now just some brute force coding to put in the page loops and grab the profile IDs. Got a family function to attend over the weekend, but hopefully by early next week I'll have something in beta to mess with. Fun! | | | Thanks for your support. Free Plugins available here. Advanced plugins available here. Hey, new product!!! BDPFrog. | | | Last edited: by mediadogg |
|
Registered: March 14, 2007 | Reputation: | Posts: 4,694 |
| Posted: | | | | I like it! But ...
Wouldn't it be better if you used the same terminology as Profiler's XML? For example ID, ID_Base, ID_LocalityID and ID_LocalityDesc. And <Credit> is Crew is Profiler's XML. And so on.
The closer you can make it to Profiler's XML, the less chance of confusion.
Just my two cents. | | | My freeware tools for DVD Profiler users. Gunnar | | | Last edited: by GSyren |
|
Registered: March 18, 2007 | Reputation: | Posts: 6,463 |
| Posted: | | | | Quoting GSyren: Quote: I like it! But ...
Wouldn't it be better if you used the same terminology as Profiler's XML? For example ID, ID_Base, ID_LocalityID and ID_LocalityDesc. And <Credit> is Crew is Profiler's XML. And so on.
The closer you can make it to Profiler's XML, the less chance of confusion.
Just my two cents. You got it! Now is the time when changes are easiest, and that is certainly most reasonable. I will make it as close as possible. | | | Thanks for your support. Free Plugins available here. Advanced plugins available here. Hey, new product!!! BDPFrog. | | | Last edited: by mediadogg |
|
Registered: March 18, 2007 | Reputation: | Posts: 6,463 |
| Posted: | | | | Ok, here is my compromise: I tried to make as much as possible identical to Profiler XML, except the credits info is formatted to make it super easy to parse for you and not force you to redo the work of parsing dividers and episode markers. Any other DVD Info that you want / need, of course I can add that easily to the export. Quote:
<?xml version="1.0" encoding="windows-1252"?> <!-- Credit Information Export (c) 2019 mediadogg Software --> <CLTInfo> <DVD> <ID>5051889528654.8</ID> <ID_Base>5051889528654</ID_Base> <ID_LocalityID>8</ID_LocalityID> <ID_LocalityDesc>France</ID_LocalityDesc> <Title>Black Storm</Title> <OriginalTitle>Into the Storm</OriginalTitle> <ProductionYear>2014</ProductionYear> <CLTCredits> <CLTCredit type ="crew" Episode="" GroupName="Visual Effects by [Hy*Drau"Lx]" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" CreditType="crew" CreditedAs="" Role="Visual Effects" Voice="False" Uncredited="False" Puppeteer="False"/> </CLTCredits> </DVD> <DVD> <ID>723952078414</ID> <ID_Base>723952078414</ID_Base> <ID_LocalityID>0</ID_LocalityID> <ID_LocalityDesc>United States</ID_LocalityDesc> <Title>Rock Slyde Private Eye</Title> <OriginalTitle></OriginalTitle> <ProductionYear>2009</ProductionYear> <CLTCredits> <CLTCredit type ="cast" Episode="" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" CreditType="cast" CreditedAs="" Role="Steve Bookerson" Voice="False" Uncredited="False" Puppeteer="False"/> <CLTCredit type ="crew" Episode="" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" CreditType="crew" CreditedAs="" Role="Producer" Voice="False" Uncredited="False" Puppeteer="False"/> </CLTCredits> </DVD> <DVD> <ID>8712626073345.30</ID> <ID_Base>8712626073345</ID_Base> <ID_LocalityID>30</ID_LocalityID> <ID_LocalityDesc>Belgium</ID_LocalityDesc> <Title>Ash vs Evil Dead: Seizoen 3</Title> <OriginalTitle></OriginalTitle> <ProductionYear>2018</ProductionYear> <CLTCredits> <CLTCredit type ="cast" Episode="4. Unfinished Business" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="1971" CreditType="cast" CreditedAs="" Role="Gary" Voice="False" Uncredited="False" Puppeteer="False"/> <CLTCredit type ="cast" Episode="6. Tales from the Rift" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="1971" CreditType="cast" CreditedAs="" Role="Gary" Voice="False" Uncredited="False" Puppeteer="False"/> </CLTCredits> </DVD> </CLTInfo>
| | | Thanks for your support. Free Plugins available here. Advanced plugins available here. Hey, new product!!! BDPFrog. | | | Last edited: by mediadogg |
|
Registered: March 18, 2007 | Reputation: | Posts: 6,463 |
| Posted: | | | | Scraping did turn out to be relatively easy. Just a bit of a snag getting the page turning logic smoothed out. Once I nail that, I will have a list of UPCs that I can run through the API, which has an "all localities" option, so I don't need to scrape the localities which would be a real pain. At that point I will have the complete list of ProfileIDs from which to request download of the XML for export. | | | Thanks for your support. Free Plugins available here. Advanced plugins available here. Hey, new product!!! BDPFrog. | | | Last edited: by mediadogg |
|
Registered: March 18, 2007 | Reputation: | Posts: 6,463 |
| Posted: | | | | Darn it, seems like some stuff you can't do anymore - at least not easily. Might have to resort to AutoIt to press a few keys. I'm not the only one. Seems others are having the same problem pressing keys inside a modern browser these days. They seem to now require an actual UI action. I'll keep plugging away. I'd like to avoid AutoIt if I can, but I've used it before and it does work well. | | | Thanks for your support. Free Plugins available here. Advanced plugins available here. Hey, new product!!! BDPFrog. | | | Last edited: by mediadogg |
|
Registered: March 13, 2007 | Reputation: | Posts: 767 |
| Posted: | | | | Quoting AiAustria: Quote: Back on topic: Credit Lookup Plus
Did anyone manage to run this very handy piece of software under Windows 10?
... or is there any other tool to get information out of the CLT tool? Still working for me! |
|
Registered: March 18, 2007 | Reputation: | Posts: 6,463 |
| Posted: | | | | Quoting marcelb7: Quote: Quoting AiAustria:
Quote: Back on topic: Credit Lookup Plus
Did anyone manage to run this very handy piece of software under Windows 10?
... or is there any other tool to get information out of the CLT tool? Still working for me! Hey that's great! Maybe share your setup - which browser, and "compatibility" settings, or anything else you think might be contributing to your success where others have failed? I will probably still continue with my project, but I'm sure some people would love to continue using that program, although apparently the author doesn't want it being used. But that is a decision that each person makes for themselves. | | | Thanks for your support. Free Plugins available here. Advanced plugins available here. Hey, new product!!! BDPFrog. |
|
Registered: March 13, 2007 | Reputation: | Posts: 767 |
| Posted: | | | | You have to log in to www.dvdprofiler.com in Internet Explorer as an administrator. If you log in via regular IE, it doesn't work. Nor does it work if you log in via dvdprofiler.com (without www), or using any other browser than IE. It's very specific. | | | Last edited: by marcelb7 |
|
Registered: May 19, 2007 | Reputation: | Posts: 5,715 |
| Posted: | | | | Quoting marcelb7: Quote: You have to log in to www.dvdprofiler.com in Internet Explorer as an administrator. If you log in via regular IE, it doesn't work. Nor does it work if you log in via dvdprofiler.com (without www), or using any other browser than IE. It's very specific. Great hint Addition: You have to check the Keep me signed in checkmark. | | | Complete list of Common Names • A good point for starting with Headshots (and v11.1) |
|
Registered: March 18, 2007 | Reputation: | Posts: 6,463 |
| Posted: | | | | Quoting mediadogg: Quote: Ok, here is my compromise:
I tried to make as much as possible identical to Profiler XML, except the credits info is formatted to make it super easy to parse for you and not force you to redo the work of parsing dividers and episode markers. Any other DVD Info that you want / need, of course I can add that easily to the export.
Quote:
<?xml version="1.0" encoding="windows-1252"?> <!-- Credit Information Export (c) 2019 mediadogg Software --> <CLTInfo> <DVD> <ID>5051889528654.8</ID> <ID_Base>5051889528654</ID_Base> <ID_LocalityID>8</ID_LocalityID> <ID_LocalityDesc>France</ID_LocalityDesc> <Title>Black Storm</Title> <OriginalTitle>Into the Storm</OriginalTitle> <ProductionYear>2014</ProductionYear> <CLTCredits> <CLTCredit type ="crew" Episode="" GroupName="Visual Effects by [Hy*Drau"Lx]" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" CreditType="crew" CreditedAs="" Role="Visual Effects" Voice="False" Uncredited="False" Puppeteer="False"/> </CLTCredits> </DVD> <DVD> <ID>723952078414</ID> <ID_Base>723952078414</ID_Base> <ID_LocalityID>0</ID_LocalityID> <ID_LocalityDesc>United States</ID_LocalityDesc> <Title>Rock Slyde Private Eye</Title> <OriginalTitle></OriginalTitle> <ProductionYear>2009</ProductionYear> <CLTCredits> <CLTCredit type ="cast" Episode="" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" CreditType="cast" CreditedAs="" Role="Steve Bookerson" Voice="False" Uncredited="False" Puppeteer="False"/> <CLTCredit type ="crew" Episode="" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" CreditType="crew" CreditedAs="" Role="Producer" Voice="False" Uncredited="False" Puppeteer="False"/> </CLTCredits> </DVD> <DVD> <ID>8712626073345.30</ID> <ID_Base>8712626073345</ID_Base> <ID_LocalityID>30</ID_LocalityID> <ID_LocalityDesc>Belgium</ID_LocalityDesc> <Title>Ash vs Evil Dead: Seizoen 3</Title> <OriginalTitle></OriginalTitle> <ProductionYear>2018</ProductionYear> <CLTCredits> <CLTCredit type ="cast" Episode="4. Unfinished Business" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="1971" CreditType="cast" CreditedAs="" Role="Gary" Voice="False" Uncredited="False" Puppeteer="False"/> <CLTCredit type ="cast" Episode="6. Tales from the Rift" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="1971" CreditType="cast" CreditedAs="" Role="Gary" Voice="False" Uncredited="False" Puppeteer="False"/> </CLTCredits> </DVD> </CLTInfo>
Any interest still remain on this? I got past a major hurdle today. I might still need an AutoIt bandaid, but all the underlying code seems to be working now. This would be the time to let me know of any tweaks. I will likely only arrange to produce the fastest XML export as I can (it will still be a grind for popular people), and other apps can format in useful ways. A reminder: this process pulls profile info directly from the online database, and does not depend on what is in your local collection. So if you want anything else to appear in the exported results, I should be able to output it, keeping performance and reasonableness in mind. (should there be an option to override the online with the local credits?) | | | Thanks for your support. Free Plugins available here. Advanced plugins available here. Hey, new product!!! BDPFrog. | | | Last edited: by mediadogg |
|
Registered: May 19, 2007 | Reputation: | Posts: 5,715 |
| Posted: | | | | From my side there definitly is interest on this topic: getting rid of IE and all its legacy stuff should be a goal for everyonye... | | | Complete list of Common Names • A good point for starting with Headshots (and v11.1) |
|