Skip to content

Luna-BLox/Luna-Crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

(If you Are viewing this on Apify, please go to the GitHub Repository instead.)

Luna Crawler

Luna Crawler is a web crawler for Roblox. It is built using the Crawlee framework in Node CommonJS (CJS).

Usage

All you need to do is run these commands:

git clone https://github.com/Luna-BLox/Luna-Crawler.git
cd Luna-Crawler
npm run start

And then you're done 🎉

Support

Device Supported
Windows ✅
Mac OS ✅
Linux ✅

Don't have a high end PC? No problem! You can use the Apify Cloud to run the crawler for you.

Supported Scrapes

Caution

These schemas aren't final and can be changed at any time!

Game Example

{
	"type": "game",
	"title": "Example Game",
	"description": "Example Game Description",
	"creator": "Community or Roblox User",
	"creatorUrl": "Roblox User or Community Url",
	"likes": 12345678,
	"dislikes": 12345678,
	"active": "1,234",
	"favorites": "1,234",
	"visits": "99.9K+",
	"voicechat": "Not Supported",
	"camera": "Not Supported",
	"created": "1/1/2024",
	"updated": "1/1/2024",
	"serversize": 12345678,
	"genre": "N/A",
	"subgenre": "N/A"
}
  • Name
  • Author
  • Maturity Level
  • Thumbnails
  • Likes
  • Dislikes
  • Description
  • Active
  • Favorites
  • Visits
  • Voice Chat Support
  • Camera Support
  • Created
  • Updated
  • Server Size
  • Genre & Subgenre
  • Social Links
  • Badges
  • Events
  • Store (Subscription and Gamepasses)

Community Example

{
	"type": "community",
	"url": "https://www.roblox.com/communities/12345678/Example#!/about",
	"name": "Example Community",
	"creator": "RobloxUser",
	"creatorUrl": "https://www.roblox.com/users/1234567890/profile",
	"members": 1234567890,
	"description": "Example Community",
	"roles": [
		{
			"name": "Member",
			"assigned": "1k+"
		},
		{
			"name": "Owner",
			"assigned": "1"
		},
		...
	],
	"games": [
		{
		"name": "Example Game",
			"url": "https://www.roblox.com/games/refer?PlaceId=1234567890"
		},
		{
		"name": "Another Example Game",
			"url": "https://www.roblox.com/games/refer?PlaceId=1234567890"
		},
		...
	]
}
  • Name
  • Creator
  • Member count
  • Description
  • Roles
  • Games
  • Social Links
  • Events
  • Store
  • Affiliates

Badge Example

{
	"type": "badge",
	"url": "https://www.roblox.com/badges/1234567890/Example-Badge",
	"name": "Example Badge",
	"creator": "Roblox User",
	"game": "Example Game",
	"gameUrl": "https://www.roblox.com/games/refer?PlaceId=1234567890"
}
  • Name
  • Author (50% - Missing Author URL)
  • Updated
  • Description
  • Game

User Example

{
	"type": "user",
	"url": "https://www.roblox.com/users/1234567890/profile/",
	"pfp": "https://tr.rbxcdn.com/30DAY-AvatarHeadshot...",
	"displayName": "Roblox User",
	"username": "@robloxuser",
	"friends": 123,
	"followers": 1234567,
	"following": 1234567,
	"about": "Example About"
}
  • Display name
  • username
  • Friend Count
  • Follower Count
  • Following Count
  • About/Description
  • Creations
  • Currently Wearing
  • Friends
  • Communities
  • Favorites
  • Roblox Badges
  • Badges
  • Statistics

Note

If you want to help out, please don't hesitate to clone the repository and create a Pull Request.

About

✨🎮 Turn a Roblox Page into a JSON/CSV

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors