Talk shop and learn about MySQL and occasionally some other stores!

Topics and RecordingsLearn From Previous Discussions!

How to JoinSome simple setup help!

Follow Us On


#DBHangOps 10/16/13 -- Resource Management, Compliance, and more

This weeks #DBHangOps is a wrap. Check out the recording below:

Hello everyone!

This Wednesday, October 16th, 2013 at 12:00pm pacific (19:00 GMT), #DBHangOps is coming up with discussion on:

  • How do you constrain over-consumption of resources by competing applications?
  • Network vs. Local storage for MySQL
    • How do you use this for HA? Do you use DRBD or floating VIPs?
  • Secure connections to MySQL (using SSL) (requested by Daniel)
    • Do you have experience with this? What's the performance impact?
  • PCI Certification with MySQL -- what changed for you?
  • MySQL-isms!
    • (From Gerry) Sub SELECTs -- Why aren't these as mature as other databases?
    • (From Daniel) GROUP_CONCAT and other OLAP Style query functions -- Why doesn't MySQL have them?
    • (From Gerry) MySQL DBAs are used to building covering indexes to avoid PK lookups -- Is there a plan for this to change?

Be sure to check out the #DBHangOps twitter search, the @DBHangOps twitter feed, or this blog post to get a link for the google hangout on Wednesday!

See all of you on Wednesday!

Show notes

How do you constrain over-consumption of resources by competing applications?

  • For starters, you'll need to know if over-consumption by a single user is happening!
    • user_statistics will be you best friend when trying to gauge resource consumption -- https://mariadb.com/kb/en/user-statistics/
      • Allows you to see information on a per-user basis for CPU time, connection counts, bytes read/written, command counters, etc.
  • If you're running MyISAM, you might be able to get away with overcommitting on memory and allowing filesystem caches to take care of things for you
    • Can dynamically tune MyISAM key buffers (InnoDB buffer pool changes require a restart)
  • You can functionally partition databases onto new machines to free up resources on a particularly busy machine

Network vs. Local storage for MySQL

  • TL;DR -- DBAs prefer local storage for simplifying debugging, reducing failure scenarios, and because databases are typically bottlenecked on I/O
  • Shared storage - issues with accessing any of the data files can leave mysql in weird states
    • NFS is a baaaaad idea because of file locking and periodic issues.
      • If MySQL can't see, lock, or perform other common file operations on it's datafiles (which can be spotty at times over NFS), it'll get very upset.
    • "One of the main challenges in dealing with shared storage is that concurrency and tenant management is incredibly difficult" -- John Cesario
  • Amazon Web Services
    • All IO on AWS is shared
    • You can pay for "Provisioned IOPS" to get a dedicated amount of IO ("It's kind of like 'Express Pass' at Disney..")
  • Percona put together a whitepaper about commonly encountered MySQL issues for their customers. SAN issues were the second highest storage issue.

Secure connections to MySQL (using SSL) (requested by Daniel)

PCI Certification with MySQL -- what changed for you?

  • User Auditing was required -- Need to know what a user changes
    • You'll need to have an audit plugin (the MySQL Security module isn't 100% solid for PCI)
    • You may need to write your own plugin to address compliance concerns. Performance hits may come with this.
  • Encrypting data at the application level is a must
  • PCI compliance adds an extreme amount of overhead to the development lifecycle