Warning: Table './oestremc_dc/watchdog' is marked as crashed and last (automatic?) repair failed query: INSERT INTO watchdog (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (0, 'php', '%message in %file on line %line.', 'a:4:{s:6:\"%error\";s:7:\"warning\";s:8:\"%message\";s:40:\"Creating default object from empty value\";s:5:\"%file\";s:113:\"/home1/oestremc/public_html/dc_d6/sites/all/modules/advanced_forum/includes/advanced_forum_preprocess_comment.inc\";s:5:\"%line\";i:140;}', 3, '', 'http://dylanchords.com/content/project-created-github', '', '54.81.170.186', 1397844630) in /home1/oestremc/public_html/dc_d6/includes/database.mysql.inc on line 135

Warning: Table './oestremc_dc/watchdog' is marked as crashed and last (automatic?) repair failed query: INSERT INTO watchdog (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (0, 'php', '%message in %file on line %line.', 'a:4:{s:6:\"%error\";s:14:\"strict warning\";s:8:\"%message\";s:62:\"Non-static method view::load() should not be called statically\";s:5:\"%file\";s:70:\"/home1/oestremc/public_html/dc_d6/sites/all/modules/views/views.module\";s:5:\"%line\";i:906;}', 3, '', 'http://dylanchords.com/content/project-created-github', '', '54.81.170.186', 1397844630) in /home1/oestremc/public_html/dc_d6/includes/database.mysql.inc on line 135

Warning: Table './oestremc_dc/watchdog' is marked as crashed and last (automatic?) repair failed query: INSERT INTO watchdog (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (0, 'php', '%message in %file on line %line.', 'a:4:{s:6:\"%error\";s:14:\"strict warning\";s:8:\"%message\";s:134:\"Declaration of date_handler_field_multiple::pre_render() should be compatible with content_handler_field_multiple::pre_render($values)\";s:5:\"%file\";s:93:\"/home1/oestremc/public_html/dc_d6/sites/all/modules/date/date/date_handler_field_multiple.inc\";s:5:\"%line\";i:185;}', 3, '', 'http://dylanchords.com/content/project-created-github', '', '54.81.170.186', 1397844630) in /home1/oestremc/public_html/dc_d6/includes/database.mysql.inc on line 135

Warning: Table './oestremc_dc/watchdog' is marked as crashed and last (automatic?) repair failed query: INSERT INTO watchdog (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (0, 'php', '%message in %file on line %line.', 'a:4:{s:6:\"%error\";s:14:\"strict warning\";s:8:\"%message\";s:134:\"Declaration of views_handler_filter::options_validate() should be compatible with views_handler::options_validate($form, &$form_state)\";s:5:\"%file\";s:91:\"/home1/oestremc/public_html/dc_d6/sites/all/modules/views/handlers/views_handler_filter.inc\";s:5:\"%line\";i:607;}', 3, '', 'http://dylanchords.com/content/project-created-github', '', '54.81.170.186', 1397844630) in /home1/oestremc/public_html/dc_d6/includes/database.mysql.inc on line 135

Warning: Table './oestremc_dc/watchdog' is marked as crashed and last (automatic?) repair failed query: INSERT INTO watchdog (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (0, 'php', '%message in %file on line %line.', 'a:4:{s:6:\"%error\";s:14:\"strict warning\";s:8:\"%message\";s:130:\"Declaration of views_handler_filter::options_submit() should be compatible with views_handler::options_submit($form, &$form_state)\";s:5:\"%file\";s:91:\"/home1/oestremc/public_html/dc_d6/sites/all/modules/views/handlers/views_handler_filter.inc\";s:5:\"%line\";i:607;}', 3, '', 'http://dylanchords.com/content/project-created-github', '', '54.81.170.186', 1397844630) in /home1/oestremc/public_html/dc_d6/includes/database.mysql.inc on line 135

Warning: Table './oestremc_dc/watchdog' is marked as crashed and last (automatic?) repair failed query: INSERT INTO watchdog (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (0, 'php', '%message in %file on line %line.', 'a:4:{s:6:\"%error\";s:14:\"strict warning\";s:8:\"%message\";s:102:\"Declaration of views_plugin_style_default::options() should be compatible with views_object::options()\";s:5:\"%file\";s:96:\"/home1/oestremc/public_html/dc_d6/sites/all/modules/views/plugins/views_plugin_style_default.inc\";s:5:\"%line\";i:24;}', 3, '', 'http://dylanchords.com/content/project-created-github', '', '54.81.170.186', 1397844630) in /home1/oestremc/public_html/dc_d6/includes/database.mysql.inc on line 135

Warning: Table './oestremc_dc/watchdog' is marked as crashed and last (automatic?) repair failed query: INSERT INTO watchdog (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (0, 'php', '%message in %file on line %line.', 'a:4:{s:6:\"%error\";s:14:\"strict warning\";s:8:\"%message\";s:130:\"Declaration of views_plugin_row::options_validate() should be compatible with views_plugin::options_validate(&$form, &$form_state)\";s:5:\"%file\";s:86:\"/home1/oestremc/public_html/dc_d6/sites/all/modules/views/plugins/views_plugin_row.inc\";s:5:\"%line\";i:134;}', 3, '', 'http://dylanchords.com/content/project-created-github', '', '54.81.170.186', 1397844630) in /home1/oestremc/public_html/dc_d6/includes/database.mysql.inc on line 135

Warning: Table './oestremc_dc/watchdog' is marked as crashed and last (automatic?) repair failed query: INSERT INTO watchdog (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (0, 'php', '%message in %file on line %line.', 'a:4:{s:6:\"%error\";s:14:\"strict warning\";s:8:\"%message\";s:126:\"Declaration of views_plugin_row::options_submit() should be compatible with views_plugin::options_submit(&$form, &$form_state)\";s:5:\"%file\";s:86:\"/home1/oestremc/public_html/dc_d6/sites/all/modules/views/plugins/views_plugin_row.inc\";s:5:\"%line\";i:134;}', 3, '', 'http://dylanchords.com/content/project-created-github', '', '54.81.170.186', 1397844630) in /home1/oestremc/public_html/dc_d6/includes/database.mysql.inc on line 135
Project created on Github | Dylan Chords



  • warning: Creating default object from empty value in /home1/oestremc/public_html/dc_d6/sites/all/modules/advanced_forum/includes/advanced_forum_preprocess_comment.inc on line 140.
  • strict warning: Non-static method view::load() should not be called statically in /home1/oestremc/public_html/dc_d6/sites/all/modules/views/views.module on line 906.
  • strict warning: Declaration of date_handler_field_multiple::pre_render() should be compatible with content_handler_field_multiple::pre_render($values) in /home1/oestremc/public_html/dc_d6/sites/all/modules/date/date/date_handler_field_multiple.inc on line 185.
  • strict warning: Declaration of views_handler_filter::options_validate() should be compatible with views_handler::options_validate($form, &$form_state) in /home1/oestremc/public_html/dc_d6/sites/all/modules/views/handlers/views_handler_filter.inc on line 607.
  • strict warning: Declaration of views_handler_filter::options_submit() should be compatible with views_handler::options_submit($form, &$form_state) in /home1/oestremc/public_html/dc_d6/sites/all/modules/views/handlers/views_handler_filter.inc on line 607.
  • strict warning: Declaration of views_plugin_style_default::options() should be compatible with views_object::options() in /home1/oestremc/public_html/dc_d6/sites/all/modules/views/plugins/views_plugin_style_default.inc on line 24.
  • strict warning: Declaration of views_plugin_row::options_validate() should be compatible with views_plugin::options_validate(&$form, &$form_state) in /home1/oestremc/public_html/dc_d6/sites/all/modules/views/plugins/views_plugin_row.inc on line 134.
  • strict warning: Declaration of views_plugin_row::options_submit() should be compatible with views_plugin::options_submit(&$form, &$form_state) in /home1/oestremc/public_html/dc_d6/sites/all/modules/views/plugins/views_plugin_row.inc on line 134.

Project created on Github

25 Jan 2012
5 posts / 0 new
Last post
ben
Anonymous's picture
Project created on Github

Hi everyone,

I’ve started work on a parser for the static content of dylanchords.info.  It’s still a bit rough but I think it’s a decent start. I started by creating a schema based on what (I think) Eyolf was looking for. The source files were parsed in Perl and put into a database.  I’ve also setup a quick and dirty codeigniter site to view the parsed data like DC1.0. It includes a nice little CRUD component to view and edit the raw/live data. Finally, I put it all up on github including the parsers, a database dump, and the codeigniter site.  Here are the links:

Please take a look and let me know what you think. I’m sure more fields need to be added and you may want to normalize. The data/parser definitely needs work, some songs parsed better than others. The original html was largely preserved and should probably be cleaned up. Perhaps the data should be massaged manually?

Ben

Eyolf Østrem
Eyolf Østrem's picture
I’ve now had a closer look,

I’ve now had a closer look, finally, and I think it’s good. Some remarks, mainly to the schema:

Tables

song_version:

The tuning field should be an id reference to a tunings table, not just a text field.

The same goes for the Venue field.

Missing fields:
- preamble
- Chords
- sounding key
- tabbedby

There should also be a field to indicate whether the song_version is live or studio. If it is studio, that almost always implies that it’s an outtake, but there are exceptions, so this has to be different fields.


Related: The outtake problem: must also record which album it is an outtake from.  Perhaps this could/should go in the album_song_version table? That would at least solve the problem with “same version on multiple albums”.

Case study: Blind Wille McTell. It’s an Infidels outtake, but it’s also a bona fide track on Bootleg Series 1-3. If the “outtake” flag were set in the song_version table, it would register as an outtake even on BS1-3, which is not what I’m after: I only want to list on the various album pages the songs that were recorded but didn’t make it to the album.  In the Blind Willie case, the album_song_version table for Infidels would have an indication that it’s an outtake there (but no such entry in the album_song_version table for BS1-3).

As for the other tables, I think they look OK. There may be some fields missing, but it’s probably easier to clean that up later anyway.

Parser

Haven’t tested it thoroughly, but it looks good, overall. I’ve come across a few strange things (e.g. in the Intro field in the album table empty lines are inserted between each line of code, and the end-tag of the <div> wrapper is not included), but once such bugs are squashed, I think it’s ready to roll.

Anonymous
Anonymous's picture
Glad you got it winkorg.I

Glad you got it winkorg.I developed it on a live server as all the other functions require you to login with Instagram which then uses a callback to a URL you have stated. This is how you get the OAuth token. So I never tried it on a local machine myself.Let me know when you have developed something I'd love to see what the library is being used for.

kettle
kettle's picture
Nice work - I uploaded
Nice work - I uploaded screenshots of my working schema to the file browser dc_ds_cs_kettle dylanchords_kettle_1

macarl

Eyolf Østrem
Eyolf Østrem's picture
Thanks a lot for this. I

Thanks a lot for this. I haven’t had time to look at it more closely yet, so this note is just to acknowledge that I’ve seen it and that I really appreciate the effort. AND that I will have a look at it ASAP.

Post new comment

CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.
Image CAPTCHA
Enter the characters shown in the image.
By submitting this form, you accept the Mollom privacy policy.