Does anyone know where I can find the dataset of all possible research publications ? I would like to get only titles and abstracts for those papers.
Restricting this question to "Computer Science" (as suggested in the comments) and reducing "all possible" to the ones which were actually published, one resource is The DBLP Computer Science Bibliography. Note that this source follows ODC-BY 1.0.
The DBLP has a search interface with an attempt to identify coauthor communities. They also offer bulk downloads in XML format.
Some other research subjects have good sources, such as PubMed for biology, medicine, etc.
First to be able to better answer: what is your definition of open scientific publications?
Second: there is for sure nothing comparable to Wikipedia or so in terms of cross-disciplinarity and amount of content. Most of this data is in the hands of big (publishing) companies. There is no central register for scientific literature. One of the best ways is to get bibliographic data and find the DOI (digital object identifier). With this, you can search in different databases for it.
But I know some big open repositories, which have a lot of open access:
Another good spot to look for Open Access publications is the Directory of Open Access Journals (DOAJ).
"all possible research publications" is way too broad of a search.
It's estimated that there are over 26,000 peer reviewed journals, and 21,000 'non-journals', not to mention all of the journals that aren't peer reviewed.
It's possble that some of those only published one issue, and went defunct ... but even then the number of articles is huge
Searching Google Scholar for the letter 'a' yields 8,460,000 results. The Astrophysics Data System is at least 9,250,000 records based on a poster from this week's LISA conference.
For books, you might try OCLC, but I think their 'open license' applies to their members, not necessarily the general public. ... that also wouldn't necessarily have 'abstract' info, except for a few phrases or sentence you might in the front matter of more recent books books.
Answering because I came to this from Google, even though it was asked ages ago. Check out constellate.org. Recent release by JSTORLabs, they integrate multiple databases, and allow access to filtered sets of up to 25k papers at a time.