This project involved developing a script for parsing the xml/csv feeds from internet and expose a PHP interface to insert the data into the database
- Reads the huge xmls from URL, file and other sources .
- Splits it into smaller xmls with configurable number of items for each child xml.
- Perform database manipulations.
- Reads the configuration from a configuration file for url,number of child xmls etc.
- In case of abort, capable of resuming from the last record.
Technologies used : PHP
- Complete PHP based solution
- Uses PHP XMLReader, XMLWriter apis for xml
Tuned for high performance.
If this interests you, I would re write this code as per your requirement