Skip to content

CLI-based tool which facilitates the scraping, parsing, and uploading of data for Nebula Labs' API.

License

Notifications You must be signed in to change notification settings

254176/api-tools

 
 

Repository files navigation

API Tools

Commitizen friendly

A CLI to scrape some really useful UTD data, parse it, and upload it to the Nebula API database for community use.

Part of Project Nebula

Contributing

Prerequisites

  • Golang 1.18.4 (or higher)

Development

Documentation for the project will be created soon, but for more information please visit our Discord

Clone the repository.

  • The grade-data directory contains .CSV files of, you guessed it, the UTD grade data!
  • The main directory contains the main file that runs the CLI.
  • The parser directory contains the files and methods that parse the scraped data.
  • The scrapers directory contains the scrapers for various UTD data sources.
  • The uploader directory contains the uploader that sends the parsed data to the Nebula API database. (Under construction)

API Tools (Under construction)

The API Tools use Golang with ChromeDP and the MongoDB Golang Driver.

Deployment

[TBD]

Questions or Feedback

If you have any questions about this project, reach out to the Project Nebula maintainers at [email protected] or open an issue or discussion on this repository.

About

CLI-based tool which facilitates the scraping, parsing, and uploading of data for Nebula Labs' API.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 99.0%
  • Other 1.0%