Database Scalability and Performance
mysql, optimized my.cnf, mysql partioning, mysql consulting
The database is frequently at the heart of every system. Designing and architecting
a scalable and fast database backend requires a strong background in
high-concurrency and high-availability web-applications, and equally as deep knowledge
of the database itself.
We'll help you setup advanced MySQL instances with a Master and multiple slaves, multiple Masters and multiple slaves, real-time database backups and snapshots, managed or automated offsite database backups. Even if you don't need multiple database servers right now, you can supercharge your application and better utilize your existing hardware, without burning money on expensive servers.
We know that your dataset is growing quickly and so are your queries per second. You're probably experiencing performance problems where your queries take too long to execute or your dataset is getting too large to run efficiently on one database server. We'll help with your OLTP or OLAP systems.
Frequently, offloading the database by using specialized applications such as TokyoCabinet/TokyoTyrant, BDB, MonetDB, column-oriented databases, and massively parallelized data warehousing techniques save you time and money.
By analyzing your existing database system, we'll identify the best strategies, suggest revisions where they are needed, and help architect the appropriate sharding, partitioning, and data-warehousing architectures to support high-throughput environments.
We can help with:
We'll help you setup advanced MySQL instances with a Master and multiple slaves, multiple Masters and multiple slaves, real-time database backups and snapshots, managed or automated offsite database backups. Even if you don't need multiple database servers right now, you can supercharge your application and better utilize your existing hardware, without burning money on expensive servers.
We know that your dataset is growing quickly and so are your queries per second. You're probably experiencing performance problems where your queries take too long to execute or your dataset is getting too large to run efficiently on one database server. We'll help with your OLTP or OLAP systems.
Frequently, offloading the database by using specialized applications such as TokyoCabinet/TokyoTyrant, BDB, MonetDB, column-oriented databases, and massively parallelized data warehousing techniques save you time and money.
By analyzing your existing database system, we'll identify the best strategies, suggest revisions where they are needed, and help architect the appropriate sharding, partitioning, and data-warehousing architectures to support high-throughput environments.
We can help with:
-
Servers
MySQL, MS SQL Server
General
- Indexes/Indeces, Multicolumn vs. Single Column
- MySQL Query Optimization
- MySQL Performance tips and tricks
- Table Denormalization for performance
- MySQL Sharding and Partitioning
- MySQL Replication
- Lazy Aggregation, Caching, Archiving
- Selecting the most applicable storage engine
- Cache and buffer tuning
- High-concurrency write environments
- Locking and transactional issues
- Batch jobs and file processing
- Dimension and OLAP Summary Tables
- MySQL Database Load Balancing
- MySQL Real-Time backup
- MySQL Storage Configurations
- MySQL Monitoring and Metrics
- Offsite backup / Cloud backup
- Active/Active or Active/Passive Failover
- Enforcing record uniqueness across tables and servers
- And much more
Database Migrations
- Assistance in moving to MySQL or SQL Server from other vendors
Common Problems
- Single server sharding
- Multi-server sharding
- Impossible mysql backups
- Frequent crashes
- Out-of-memory
- No indeces or bad indeces
- Tables too wide
- MySQL as a Queue
- Slow MySQL Order By
- Overly-normalized schema
- One db for everything
- Exploding binlog files
- Bad my.cnf
- Using MyISAM
- No caching
- Too many table updates
- Too many records
- Table deadlocks
- Picking a storage engine
- Online OLAP/OLTP
- Key/Value Storage
- Long database queries
- MySQL partioning is slow
- Slow Randomization
- Queries breaking replication
- DNS problems
- Fulltext indexing and search
- Using db for everything
- Schema version management
MySQL is a trademark of Sun Microsystems.
InnoDB is a trademark of Oracle Corp.
InnoDB is a trademark of Oracle Corp.
