March/24 Highlights; External Health Checks for Clickhouse using Prometheus / Switching to Spot Instances & More

In March our infrastructure management team navigated through 79 tasks, each aimed at enhancing performance, reducing costs, and ensuring robust security measures. This article delves into the significant work accomplished, highlighting the team's proactive approach to managing different infrastructures for our partners.

Cloud Cost Optimization and Resource Management

Last month, a main goal was to cut costs for one of our clients. The team moved to spot instances, which greatly reduced the operating costs. They also did a thorough check and got rid of unnecessary CloudWatch metrics, logs, and alarms, making the use of resources more efficient.

Database Management and Migration

The team moved MySQL and ElasticSearch/OpenSearch databases to new Azure systems for one of our partners, making sure the switch was smooth without losing any data quality. They also made important updates and improvements, like setting up ClickHouse and making MongoDB indexes better.

Monitoring and System Health

For another partner our team improved system health with better monitoring methods. Establishing external health checks and adding Prometheus for ClickHouse metrics tracking were crucial. These efforts gave us a detailed view of how the system was performing and allowed us to spot and fix problems early, making sure services ran without any interruptions.

Deployment and Configuration Enhancements

Moving services over to Kubernetes and setting up new cloud environments made the deployment process smoother and faster for another partner. We also introduced autoscaling for the workers, which means their system can automatically adjust to handle more or less work as needed. Plus, we improved CI/CD pipelines. These changes have made their operations better, allowing us to manage their infrastructure in a more flexible and quick-reacting way.

Security and Compliance

By keeping a close eye on security and regularly checking and improving MongoDB database setups, we made sure our client's systems were safe and met official standards.

Those were the key achievements in March for different clients.

Stay tuned for the April updates and let us know if you need our cloud infrastructure management best practices.