(中科) Senior SRE Engineer - Big Data Platform
About the Role:
Are you passionate about architecting and ensuring the scalability, reliability, and observability of massive-scale, distributed data platforms? We are seeking a Senior Site Reliability Engineer (SRE) to join our team. In this role, you will play a critical part in designing, optimizing, and maintaining our next-generation, high-throughput on-premise infrastructure. You will leverage modern SRE methodologies and cloud-native technologies to ensure high availability and robust performance for our distributed data fabric, advanced storage systems, modern lakehouse architectures, and private cloud computing platforms within a high-security, high-tech manufacturing environment.
Key Responsibilities:
• Enterprise Storage & Data Platform Management: Architect, deploy, and manage enterprise-grade Kubernetes clusters, distributed NoSQL databases (Apache Cassandra), and distributed Object Storage solutions (e.g., Ceph, SeaweedFS) to guarantee 24/7 high availability, performance, and data durability within a private network environment.
• Lakehouse & Query Engine Optimization: Manage and optimize modern open table formats, specifically Apache Iceberg, and distributed query engines like Trino, ensuring low-latency, high-performance data access and metadata management across heterogeneous data sources.
• Database & Cache Management: Oversee the lifecycle, performance tuning, and high-availability configuration of relational databases (PostgreSQL) and distributed caching layers (Redis).
• Modern Observability Framework: Design and implement an advanced observability and distributed tracing architecture utilizing OpenTelemetry (OTel), Grafana, Tempo, and the ELK Stack to enable proactive monitoring, anomaly detection, and rapid root-cause analysis (RCA).
• Automation, Governance & Security: Drive automation initiatives for cluster management and deployment. Ensure all private data platforms strictly adhere to enterprise data governance, internal compliance, and rigorous isolation security standards.
• Cross-Functional Collaboration: Partner closely with data engineering, architecture, and cross-functional infrastructure teams to understand performance bottlenecks and deliver reliable, scalable infrastructure solutions.
Required Skills and Experience:
• Industry Background: At least 3 years of experience within the semiconductor industry or equivalent high-reliability, mission-critical production environments (e.g., fab automation, highly secured air-gapped systems).
• Containerization & Orchestration: Proven, hands-on experience in Kubernetes administration and private-cloud infrastructure management.
• Data Lakehouse & Querying: Practical experience with Apache Iceberg table management, metadata optimization, and configuring/tuning Trino (or Presto) architectures for high-performance querying across data fabrics.
• Database Administration: Strong expertise in Apache Cassandra administration, troubleshooting, and cluster performance tuning, along with experience managing production PostgreSQL and Redis environments.
• Object Storage Architecture: Practical experience in the architectural design, deployment, and management of distributed Object Storage systems such as Ceph or SeaweedFS in an on-premise setup.
• Modern Observability Stack: Deep expertise in building comprehensive monitoring dashboards, log aggregation, and distributed tracing systems using Grafana, ELK Stack, OpenTelemetry (OTel), and Tempo.
• Infrastructure Automation: Proficiency in Python for developing automation tools, implementing Infrastructure as Code (IaC) principles, and deep knowledge of Unix commands / Shell scripting.
【工作地點】中科(台中市大雅區中部科學園區科雅一路8號)
【條件要求】
學歷要求:碩士
科系要求:資訊工程相關 │ 資訊管理相關
相關經驗:3年以上
語言能力:英文 中級
管理責任:No
輪班需求:No
出差需求:無