Revisions to How can I work with a 4GB csv file?

Pretty link for hearing impaired accessibility

Source Link

edit approved Oct 21, 2022 at 14:07

278
1
3
9

What's the best way to access a 4GB csv file?

I would like get a 'cut' of this open data set: Full Replacement Monthly NPI File, available here http://nppes.viva-it.com/NPI_Files.htmlavailable here.

Specifically, I want only the rows for hospitals; though, one might want the rows for healthcare clearing houses, or home health agencies, etc.

The unzipped NPI file is 4.8GB, which is too large for my desktop applications. It is an interesting barrier to open data.

Any suggestions?

Question Protected by philshem

occurred Jul 1, 2019 at 12:14

edited tags

Link

edited May 10, 2017 at 11:33

philshem

17.7k
7
69
171

edited tags

Link

edited Apr 17, 2015 at 14:20

Patrick Hoefler

5.8k
4
32
47

tool-request data-format csv

edited tags

Link

edited Apr 17, 2015 at 13:54

Patrick Hoefler

5.8k
4
32
47

Loading

edited tags

Link

edited Dec 31, 2014 at 12:08

philshem

17.7k
7
69
171

Loading

edited tags

Link

edited Dec 22, 2014 at 16:11

philshem

17.7k
7
69
171

Loading

edited tags

Link

edited Nov 25, 2014 at 13:09

Jeanne Holm

4.4k
1
19
40

Loading

edited tags

Link

edited Dec 5, 2013 at 0:01

fgregg

5.1k
17
37

Loading

Tweeted twitter.com/#!/StackOpenData/status/398849053616013312

occurred Nov 8, 2013 at 16:26

make it clear this is about csv, and he's looking for tools

Source Link

edited Nov 7, 2013 at 15:29

fgregg

5.1k
17
37

Loading

Source Link

asked Nov 7, 2013 at 3:23

user1453

949
1
7
3

Loading

Stack Exchange Network

Return to Question