Data Infrastructure Engineer

2 months ago


Bengaluru, India Mitchell Martin Inc. Full time
JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated solutions that help bring data to life. You have experience building and maintaining ETLs, data pipelines, and data models. Beyond your strong technical skills, you are a collaborator who is a passionate advocate for empowering and enlightening others with the power of data to help turn information into knowledge and actionable insights.

A SNAPSHOT OF YOUR RESPONSIBILITIESDrive and participate in the definition, the direction, and the development of the Data platformWork with internal stakeholders, data engineers and data science team to scope the requirements, evaluate business needs and objectivesDesign and develop highly scalable, reliable, extensive, and maintainable Data Processing FrameworksEstablish and implement best engineering practices such as architectural design, unit and regression testing, test-driven development, pair programming, and continuous integration frameworksAssist with process improvement with a customer focused, progressive mindsetUnderstand data classification and adhere to the information protection and privacy restrictions on dataProficient in containerization technologies, including Docker, and container orchestration with KubernetesExperience with Terraform, CloudFormation and CDKExperience with Building CICD Frameworks using Jenkins, GitHubActions for Automated DeploymentsMaintain Git lab Repositories, Handling Releases and Branching activitiesWHAT YOU WILL NEED5+ years as a professional Database Infrastructure engineer with experience in production scale platformsStrong experience with distributed data architectures and big data processing technologies (Spark, EMR, Hadoop, Hive)Strong experience with Configuration Management, Continues integration and DevOpsExpert knowledge of AWS Analysis services like Redshift, Glue, Athena, Lake FormationStrong knowledge on Python or similar scripting languageStrong experience with Realtime Frameworks, collection, and processing Realtime data using kinesis Data Streams, KCL, KDA and FirehosesStrong understanding of AWS security services including KMS, CloudTrail, STSStrong understanding of Kinesis/Glue frameworks and Spark Streaming for building Realtime analyticsExpert in CICD framework, Preferably GitHubActions, Jenkins and GitHub for version controllingExpert knowledge on Blue/Green Deployment for Lambda and Microservices Expert Knowledge on Elastic Containers and Elastic Container ServicesDiscerning appreciation of best practices in designing data lakes/lake houses, mentoring junior members, peer review and recommendationProven ability to deliver high quality, production ready codeExpert understanding of the agile software development life cycleStrong customer service and communication skills (verbal and written) to effectively interact with a diverse team of people across business and engineeringBachelor’s degree in computer scienceNICE TO HAVE, BUT NOT A DEALBREAKERExperience with Snowflake and Delta Lake technologies is a plus



  • Bengaluru, Karnataka, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...


  • Bengaluru, Karnataka, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight.You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...


  • Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...


  • Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTION As a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...


  • Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...


  • Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...


  • Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTION As a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...


  • Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...


  • Bengaluru, India Top Talent Technologies Pvt Ltd Full time

    Job Description :- Design, provision, and maintain data infrastructure using cloud-native services (e.g., Amazon MSK, Apache NiFi).- Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration.- Optimize data infrastructure for performance, scalability, and cost-effectiveness.- Monitor and...


  • Bengaluru, India Top Talent Technologies Pvt Ltd Full time

    Job Description :- Design, provision, and maintain data infrastructure using cloud-native services (e.g., Amazon MSK, Apache NiFi).- Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration.- Optimize data infrastructure for performance, scalability, and cost-effectiveness.- Monitor and...


  • Bengaluru, India Fox Corporation Full time

    OVERVIEW OF THE COMPANYFox CorporationUnder the FOX banner, we produce and distribute content through some of the world’s leading and most valued brands, including: FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations and Tubi Media Group. We empower a diverse range of creators to imagine and develop culturally significant content, while...


  • Bengaluru, India Silq Full time

    About Silq:SILQ’s core mission is to simplify global trade and create a cost-effective and sustainable supply chain that is accessible to everyone. Thinking about supply chain optimization from first principles, The team in India will focus on building the next generation of tooling for factories and a mobile application to collect quality data from the...

  • AI Data Engineer

    2 weeks ago


    Bengaluru, India ApicalGo Consultancy Full time

    Primary Purpose :Building and maintaining the company's data infrastructure on the AWS cloud platform, with a specific focus on supporting AI model training, development, and deployment. This includes designing, developing, and implementing data pipelines, ensuring the secure and efficient flow of data for our AI models.Responsibilities :Data for AI...

  • AI Data Engineer

    2 months ago


    Bengaluru, India ApicalGo Consultancy Full time

    Primary Purpose :Building and maintaining the company's data infrastructure on the AWS cloud platform, with a specific focus on supporting AI model training, development, and deployment. This includes designing, developing, and implementing data pipelines, ensuring the secure and efficient flow of data for our AI models.Responsibilities :Data for AI...


  • Bengaluru, India Fox Corporation Full time

    OVERVIEW OF THE COMPANY Fox CorporationUnder the FOX banner, we produce and distribute content through some of the world’s leading and most valued brands, including: FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations and Tubi Media Group. We empower a diverse range of creators to imagine and develop culturally significant...


  • Bengaluru, India Fox Corporation Full time

    OVERVIEW OF THE COMPANY Fox CorporationUnder the FOX banner, we produce and distribute content through some of the world’s leading and most valued brands, including: FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations and Tubi Media Group. We empower a diverse range of creators to imagine and develop culturally significant...


  • Bengaluru, Karnataka, India Top Talent Technologies Pvt Ltd Full time

    Job Description : Design, provision, and maintain data infrastructure using cloudnative services (e.g., Amazon MSK, Apache NiFi). Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration. Optimize data infrastructure for performance, scalability, and costeffectiveness. Monitor and...


  • Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as an Infrastructure EngineerWe'll look to you to develop and implement core infrastructure technologies, products and services against customer and non-functional requirementsIn order to achieve a first-class customer experience, you'll make sure the infrastructure technology is engineered to comply with security, availability and resilience,...


  • Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as an Infrastructure EngineerWe'll look to you to develop and implement core infrastructure technologies, products and services against customer and non-functional requirementsIn order to achieve a first-class customer experience, you'll make sure the infrastructure technology is engineered to comply with security, availability and resilience,...


  • Bengaluru, Karnataka, India Silq Full time

    About Silq: SILQ's core mission is to simplify global trade and create a cost-effective and sustainable supply chain that is accessible to everyone.Thinking about supply chain optimization from first principles, The team in India will focus on building the next generation of tooling for factories and a mobile application to collect quality data from the...