It’s one thing to talk about “big data”, it’s another to make it accessible, day in, day out, and in a form which is actually usable by real people, not just analysts.
That’s what Public View does.
Here’s some or the data loaded today. We never stop, but we don’t process the really big data sets until the evening so they don’t affect performance for users during the day.
Processing involves reading, understanding and formatting data from sources as different as NHS manually prepared CSV files unstable formats through to PDF files hiding the data in places you’d not think to look.
This is what we do, so you don’t have to.