DBMS Notes
This unit explored database technologies beyond the traditional centralized relational model — distributed databases, NoSQL systems, big data architectures,...
Overview
This unit explored database technologies beyond the traditional centralized relational model — distributed databases, NoSQL systems, big data architectures, data warehousing, and cloud-native database services. These topics represent the current state of the industry where organizations operate at global scale with diverse data requirements.
NoSQL Databases
Non-relational databases designed for specific data models and access patterns, offering horizontal scalability and flexible schemas.
NoSQL Categories
| Category | Data Model | Example | Best For |
|---|---|---|---|
| Key-Value | Simple key-value pairs | Redis, DynamoDB | Caching, session storage |
| Document | JSON/BSON documents | MongoDB, CouchDB | Content management, catalogs |
| Column-Family | Column groups per row key | Cassandra, HBase | Time-series, analytics |
| Graph | Nodes and edges | Neo4j, Amazon Neptune | Social networks, recommendations |
SQL vs. NoSQL Decision Guide
| Choose SQL When | Choose NoSQL When |
|---|---|
| Complex joins needed | Simple lookups dominate |
| ACID transactions critical | Eventual consistency acceptable |
| Schema is stable and well-defined | Schema evolves rapidly |
| Data is highly structured | Data is semi-structured or unstructured |
| Moderate scale (single server) | Massive scale (horizontal scaling needed) |
Data Warehousing
A data warehouse is a centralized repository optimized for analytical queries (OLAP) rather than transactional processing (OLTP).
OLTP vs. OLAP
| Aspect | OLTP | OLAP |
|---|---|---|
| Purpose | Day-to-day transactions | Analysis and reporting |
| Queries | Simple, short, frequent | Complex, long, infrequent |
| Data | Current, operational | Historical, aggregated |
| Normalization | Highly normalized (3NF) | Denormalized (star/snowflake) |
| Users | Clerks, applications | Analysts, managers |
| Example | Bank transactions | Quarterly sales analysis |
Star Schema vs. Snowflake Schema
Star Schema
Central FACT table (Sales: product_id, store_id, date_id, amount, quantity)
Dimension tables directly connected (Product, Store, Date)
Simple joins, faster queries, some redundancy in dimensions
Snowflake Schema
Same as star but dimensions are normalized into sub-dimensions
Product → Category → Department (chain of dimension tables)
Less redundancy but more complex joins
Big Data and DBMS
Big data refers to datasets too large or complex for traditional database systems to handle efficiently.
The 5 Vs
| V | Meaning | Example |
|---|---|---|
| Volume | Massive amounts of data | Petabytes of social media posts |
| Velocity | High speed of data generation | Real-time sensor streams |
| Variety | Multiple data formats | Text, images, video, logs |
| Veracity | Data quality uncertainty | Incomplete, noisy, inconsistent |
| Value | Extracting useful insights | Business intelligence from raw data |
Key Technologies
Hadoop Ecosystem
HDFS: Distributed file system for storing big data
MapReduce: Programming model for parallel processing
Hive: SQL-like querying on Hadoop data
HBase: NoSQL database on top of HDFS
Apache Spark
In-memory processing (100x faster than MapReduce for some workloads)
Supports batch processing, streaming, machine learning, graph processing
Cloud Databases
Database services provided by cloud platforms, eliminating hardware management overhead.
Service Models
| Model | User Manages | Provider Manages | Examples |
|---|---|---|---|
| IaaS (DB on VM) | Everything except hardware | Hardware, networking | EC2 + self-installed MySQL |
| DBaaS (Managed) | Schema, queries | Hardware, patching, backups, scaling | Amazon RDS, Azure SQL |
| Serverless | Queries only | Everything including capacity | Amazon Aurora Serverless, DynamoDB |
Database Security
Protecting databases from unauthorized access, data breaches, and integrity violations.
Security Layers
| Layer | Mechanism | Example |
|---|---|---|
| Authentication | Verify user identity | Username/password, certificates, MFA |
| Authorization | Control access rights | GRANT/REVOKE, role-based access control |
| Encryption | Protect data confidentiality | TDE (at rest), TLS (in transit) |
| Auditing | Track all access | Audit logs, compliance reports |
| Integrity | Prevent unauthorized modification | Checksums, digital signatures |
-- Authorization example
GRANT SELECT ON Employee TO hr_role;
GRANT INSERT, UPDATE ON Employee TO hr_manager;
REVOKE DELETE ON Employee FROM intern_role;Key Comparisons for Quick Revision
| Technology | Strength | Weakness |
|---|---|---|
| Centralized RDBMS | ACID, complex queries | Limited scalability |
| Distributed RDBMS | Scalability + ACID | Complex management |
| NoSQL | Flexibility, scale | Limited query power |
| Data Warehouse | Analytics performance | Not for transactions |
| Cloud Database | Managed, elastic | Vendor lock-in, latency |
Exam Focus
Revise definitions, diagrams, examples, and short-answer points for Unit 6 Summary — Advanced Topics in DBMS.
Interview Use
Prepare one clear explanation, one practical example, and one common mistake for this Database Management Systems (DBMS) topic.
Search Terms
dbms, database management systems (dbms), unit, summary, unit 6 summary — advanced topics in dbms
Related Database Management Systems (DBMS) Topics