We are seeking an experienced Tech Lead to drive the design, development, and delivery of scalable data processing and streaming solutions. The successful candidate will provide technical leadership across data engineering initiatives, guide development teams, and contribute to the architecture of high-performance distributed systems built on modern cloud and big data technologies.
Key Responsibilities
- Lead the technical design and implementation of large-scale data processing and streaming applications.
- Define architecture standards and best practices for distributed data platforms.
- Design, develop, and optimize batch and real‑time data pipelines using Apache Spark and Kafka technologies.
- Build and maintain scalable APIs following OpenAPI specifications.
- Perform system analysis, identify performance bottlenecks, and implement optimization strategies.
- Collaborate with product owners, architects, data engineers, and business stakeholders to translate requirements into technical solutions.
- Mentor and support development teams through code reviews,
technical guidance, and knowledge sharing.
- Ensure solutions are secure, scalable, maintainable, and aligned with enterprise standards.
- Drive continuous improvement initiatives across development processes, architecture, and platform reliability.
- Participate in technical decision‑making and roadmap planning.
Required Skills & Experience
Technical Skills
- Strong experience with Java development in enterprise environments.
- Solid expertise in Apache Spark, including:
- Spark SQL
- Spark Structured Streaming
- Distributed data processing
- Hands‑on experience with the Cloudera ecosystem.
- Strong knowledge of Apache Kafka and Kafka Streams.
- Experience developing applications using Scala.
- Expertise in designing and implementing RESTful APIs using OpenAPI specifications.
- Strong understanding of SQL databases and data modeling concepts.
- Experience working with cloud platforms, parti