Databases
[!NOTE] We’ve just added some awesome new utilities to
LiteJsonDb
to make your coding even smoother. For a quick overview and examples, check out our wiki for all the details.
Hey there! Welcome to LiteJsonDb, your friendly, lightweight JSON-based database. Inspired by the simplicity and real-time capabilities of Firestore, LiteJsonDb makes managing your data a breeze. It's packed with features like encryption, backups, and solid error handling—all without the heavy lifting.
Let's face it: sometimes you don't need a complex database setup. Maybe you're building a small project, a quick prototype, or you just want a straightforward way to store and retrieve JSON data. LiteJsonDb is here for those moments. It's simple, efficient, and gets the job done without any fuss.
[!NOTE] LiteJsonDb makes managing JSON data simple and enjoyable. Whether you're building a small app or just need a lightweight data storage solution, LiteJsonDb has you covered. Enjoy!
Getting started is super easy. Just install the package via pip and you're good to go:
pip install litejsondb
A new version is available type pip install --upgrade litejsondb
to update
First things first, import the JsonDB
class and initialize your database:
import LiteJsonDb
# Initialize the database with encryption enabled
db = LiteJsonDb.JsonDB() # Some parameters can be passed here
Enable logging to track all database operations. This is useful for debugging or monitoring activities:
db = LiteJsonDb.JsonDB(enable_log=True)
Avoid losing your data by enabling automatic backups. A backup file is created whenever you save changes:
db = LiteJsonDb.JsonDB(auto_backup=True)
By default if you pass crypted to True il will use the minimal encryption system (Base64)
db = LiteJsonDb.JsonDB(crypted=True)
Secure your data with Fernet encryption
db = LiteJsonDb.JsonDB(crypted=True, encryption_method="fernet", encryption_key="your-secret-key")
If no key is provided, the system will raise an error to ensure your data remains secure.
Combine logging, automatic backups, and encryption in one workflow:
import LiteJsonDb
# Initialize the database with logging, auto-backup, and encryption
db = LiteJsonDb.JsonDB(
enable_log=True,
auto_backup=True,
crypted=True,
encryption_method="fernet",
encryption_key="my-secure-key"
)
Adding data is a breeze. Just use the set_data
method. If the key already exists, you'll get a friendly reminder to use edit_data
instead.
# Set data without extra-data db.set_data("posts") # Set data with extra-data db.set_data("users/1", {"name": "Aliou", "age": 20}) db.set_data("users/2", {"name": "Coder", "age": 25})
Need to update data? No problem. Use the edit_data
method. It merges the new data with the existing data, so nothing gets lost.
# Edit data db.edit_data("users/1", {"name": "Alex"})
Retrieving data is as simple as it gets. Use the get_data
method.
# Get data print(db.get_data("users/1")) # Output: {'name': 'Alex', 'age': 20} print(db.get_data("users/2")) # Output: {'name': 'Coder', 'age': 25}
[!TIP] You can directly access specific data by using paths in the
get_data
method. For example, to get only the user's name, you can do:
print(db.get_data("users/1/name"))
Here, you get the user's name without retrieving other parts of the data.
Need to delete something? The remove_data
method has you covered.
# Remove data db.remove_data("users/2")
Want to see everything? Use the get_db
method. Set raw=True
if you want the data in a readable format.
# Get the full database print(db.get_db(raw=True))
This new feature was integrated in response to the issue raised about improving data search capabilities. This function allows you to search for values within your database, either across the entire database or within a specific key. This enhancement makes finding your data much easier and more efficient.
The search_data
function provides two main modes of search:
Use the search_data
Function
Here’s how you can use the search_data
function:
Basic Search: To search for a value across the entire database, use the following code:
results = db.search_data("Aliou")
print(results)
This will search for the value "Aliou"
throughout all the keys in your database.
Key-specific Search: To search for a value within a specific key, use the following code:
results = db.search_data("Aliou", key="users")
print(results)
This will search for the value "Aliou"
specifically within the "users"
key.
This feature was integrated to help you easily back up your files, such as your database, directly to a Telegram chat. By using this method, you can safely back up important files automatically to a Telegram conversation.
The backup_to_telegram
function allows you to back up any file to Telegram via a bot. You will need two essential pieces of information: the bot token and the chat ID where the file will be sent.
Obtain your Telegram bot token
To use this feature, you first need to create a bot on Telegram using @BotFather. Once your bot is created, BotFather will provide you with a token that you will use for authentication.
Find your chat ID
You can get your chat ID by using @MissRose_bot and typing /id
. It will give you your unique chat ID.
Use the backup_to_telegram
Function
Here's how to use the backup_to_telegram
function:
python
db.backup_to_telegram("your_token", "your_chat_id")
This will send the backup file to the specified chat ID using your Telegram bot.
This feature was integrated to allow you to easily export your data to CSV format. This makes it convenient to share and analyze your data outside the application by creating CSV files that can be opened with spreadsheet software like Excel or Google Sheets.
The export_to_csv
method allows you to export either a specific collection or the entire database. Here’s how to use it:
Prepare your data
Ensure that the data you want to export is well-structured. You can have your data as dictionaries or lists of dictionaries. For example:
# Adding example data
db.set_data("users", {
"1": {"name": "Aliou", "age": 20},
"2": {"name": "Coder", "age": 25}
})
Use the export_to_csv
Method
Here’s how to call the method to export data:
To export a specific collection, you need to provide the corresponding key:
# Export a specific collection
db.export_to_csv("users")
If you want to export all the data from the database, you can call the method without parameters:
# Export the entire database
db.export_to_csv()
This feature is experimental and may not support all data formats. If you attempt to export a collection that does not exist, an error message will be displayed:
If you receive errors like this: Oops! An error occurred during CSV export: ...
we recommend opening an issue in our repository so we can address it. Your feedback is valuable, and we appreciate your patience as we continue to improve this feature!
In LiteJsonDb, subcollections are a way to organize your data hierarchically. Think of them as nested structures that allow you to group related data together under a parent key. This feature is especially useful when you want to manage complex data relationships without losing the simplicity of JSON.
Subcollections are essentially collections within collections. For example, if you have a main collection of users, you might want to organize their posts into separate subcollections. Here’s how you can work with them:
Using subcollections helps you maintain a clear structure in your data, making it easier to manage and query.
Organize your data with subcollections. Easy peasy.
# Set subcollection data db.set_subcollection("groups", "1", {"name": "Admins"})
Editing items within a subcollection? No sweat.
# Edit subcollection data db.edit_subcollection("groups", "1", {"description": "Admin group"})
Need to retrieve specific subcollections or items? We've got you.
# Get subcollection data print(db.get_subcollection("groups")) # Get custom item from the subcollection data print(db.get_subcollection("groups", "1"))
Removing items from subcollections is just as simple.
# Remove subcollection data db.remove_subcollection("groups", "1")
LiteJsonDb is all about being helpful. Here are some friendly, colorful error messages to guide you:
edit_data
.Here's how your project might look if your initialized LiteJssonDb
:
project/ │ ├── database/ │ ├── db.json │ ├── db_backup.json │ └── LiteJsonDb.log └── your_code.py
main.py
Let's put it all together with an example main.py
file:
import LiteJsonDb # Initialize the database with encryption enabled db = LiteJsonDb.JsonDB() # Add some initial data # Set data without extra-data db.set_data("posts") # Set data with extra-data db.set_data("users/1", {"name": "Aliou", "age": 20}) db.set_data("users/2", {"name": "Coder", "age": 25}) # Modify existing data db.edit_data("users/1", {"name": "Alex"}) # Retrieve and print data print(db.get_data("users/1")) print(db.get_data("users/2")) # Remove data db.remove_data("users/2") # Perform a basic search results = db.search_data("Aliou") print("Basic Search Results:", results) # Perform a key-specific search results = db.search_data("Aliou", key="users") print("Key-specific Search Results:", results) # Retrieve the full database print(db.get_db(raw=True)) # Work with subcollections db.set_subcollection("groups", "1", {"name": "Admins"}) db.edit_subcollection("groups", "1", {"description": "Admin group"}) print(db.get_subcollection("groups")) db.remove_subcollection("groups", "1") # IF YOU WANT TO BACKUP THE DATABASE ON TELEGRAM # db.backup_to_telegram("your_token", "your_chat_id") """ IF YOU WANT TO EXPORT YOUR DATA ON CSV FORMAT # Export a specific collection db.export_to_csv("users") # Export the entire database db.export_to_csv() """
set_data
vs. Subcollectionsset_data
The set_data
method is used to add or update data at a specific path. If the key already exists, you will need to use edit_data
to modify it. This method is great for simple key-value pairs or straightforward data structures.
# Set data db.set_data("users/1", {"name": "Aliou", "age": 20})
Subcollections, on the other hand, are used to create and manage nested structures within your database. They allow you to group related data under a parent key, providing a more organized way to handle complex relationships. Subcollections are essentially collections within collections.
# Set subcollection data db.set_subcollection("groups", "1", {"name": "Admins"})
set_data
is used for flat data structures, while subcollections allow for hierarchical organization.set_data
for simple key-value pairs and set_subcollection
when you need nested collections.By understanding these differences, you can choose the appropriate method for your data management needs, ensuring a well-organized and efficient database.
We’re always striving to enhance LiteJsonDb. Here’s what’s on our radar:
We welcome contributions, suggestions, and feedback to make LiteJsonDb even better! If you have ideas for improvements or want to fix a bug, feel free to:
Your feedback and contributions are greatly appreciated and help us keep LiteJsonDb growing and improving.
LiteJsonDb is a labor of love, and your support can make a big difference! If you’re enjoying the project and want to show your appreciation, here are a few ways you can help:
One of the best ways to support LiteJsonDb is to fork the repository and give it a star on GitHub. It’s like a virtual high-five and helps us spread the word about the project. Plus, it shows us that you value the work we’re doing!
If you’re feeling extra generous and want to contribute financially, we’d be incredibly grateful. Donations help us cover costs and keep the project running smoothly. You can support us in the following ways:
1Nn15EttfT2dVBisj8bXCnBiXjcqk1ehWR
.Your support, whether through a star, a fork, or a donation, helps keep LiteJsonDb alive and thriving. Thank you for being awesome!
Cheers and happy coding! 🚀