Tech Lead

AWS Tech Lead – TBAR Program

Incedo is a US-based consulting, data science and technology services firm with over 4,000 people helping clients from our six offices across US and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and design capabilities coupled with deep domain understanding. We combine services and products to maximize business impact for our clients in telecom, financial services, product engineering and life science & healthcare industries.

Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep technology and domain experts, and global teams. Incedo University, our learning platform, provides ample learning opportunities starting with a structured onboarding program and carrying throughout various stages of your career. A variety of fun activities are also an integral part of our friendly work environment. Our flexible career paths allow you to grow into a program manager, a technical architect, or a domain expert based on your skills and interests.

Location: [Charlotte or NJ] 

Employment Type: [Full-time]

About the Role:

We are seeking an experienced AWS Tech Lead to drive the architecture, development, and delivery of modern data ingestion, transformation, and orchestration pipelines for the Transaction Book of Records (TBAR) Program. This role will lead the engineering team in implementing scalable, secure, high-availability cloud data solutions, while championing best practices across the delivery lifecycle.

Role and responsibilities

• Lead the end-to-end design and development of AWS-based ELT pipelines using AWS Glue, PySpark, and Python to process transactional data.
• Architect and implement high availability data consumption patterns in the cloud, ensuring resiliency, failover, and business continuity.
• Design event-driven, scalable data pipelines leveraging AWS Lambda, EventBridge, Step Functions, and Kafka for streaming and pub/sub data distribution.
• Oversee infrastructure provisioning and automation using Terraform, ensuring Infrastructure as Code (IaC) practices are embedded into the SDLC.
• Lead CI/CD implementation using GitHub Actions and Octopus Deploy, integrating SonarQube for continuous code quality and test coverage monitoring.
• Collaborate with data architects, product owners, and stakeholders to align data solutions with technical and business requirements.
• Mentor and guide a team of engineers, reviewing designs and code to ensure consistency with architectural and quality standards.
• Optimize data storage, access, and indexing strategies in Postgres to support TBAR reporting and downstream analytics.
• Act as a subject matter expert in Kafka-based streaming architectures for real-time data ingestion and dissemination across systems.
• Troubleshoot complex technical issues across data ingestion, orchestration, and deployment layers, proactively identifying risks and improvements.

Technical skills and Experience: The candidate must demonstrate proficiency in,

• 12+ years of experience in data engineering, software development, or cloud architecture, with 3+ years in technical leadership capacity.
• Strong hands-on expertise with AWS Glue, AWS Lambda, Step Functions, EventBridge, and Terraform.
• Deep experience building high availability, fault-tolerant data pipelines in the cloud.
• Proficiency in Kafka for streaming and pub/sub implementations within enterprise data platforms.
• Solid programming skills in PySpark and Python for large-scale data transformation.
• Practical experience with CI/CD pipelines using GitHub Actions, Octopus Deploy and integrating SonarQube for code quality.
• Strong knowledge of Postgres database administration, query optimization, and integration into data pipelines.
• Proven track record in implementing unit tests, test automation, and enforcing code review standards.
• Excellent communication, stakeholder engagement, and cross-team collaboration skills.

Qualifications

• B.Tech., M.Tech. or MCA degree from a reputed university
• AWS Certified Solutions Architect or equivalent cloud certification.
• Experience working in financial services or large-scale transaction processing environments.
• Familiarity with data governance, data lineage, and regulatory data compliance in cloud platforms.

We are an Equal Opportunity Employer

We value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.