Data Infrastructure Engineer

2 weeks ago

Bengaluru, India Mitchell Martin Inc. Full time

JOB DESCRIPTION

As a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated solutions that help bring data to life. You have experience building and maintaining ETLs, data pipelines, and data models. Beyond your strong technical skills, you are a collaborator who is a passionate advocate for empowering and enlightening others with the power of data to help turn information into knowledge and actionable insights.


A SNAPSHOT OF YOUR RESPONSIBILITIES

  • Drive and participate in the definition, the direction, and the development of the Data platform
  • Work with internal stakeholders, data engineers and data science team to scope the requirements, evaluate business needs and objectives
  • Design and develop highly scalable, reliable, extensive, and maintainable Data Processing Frameworks
  • Establish and implement best engineering practices such as architectural design, unit and regression testing, test-driven development, pair programming, and continuous integration frameworks
  • Assist with process improvement with a customer focused, progressive mindset
  • Understand data classification and adhere to the information protection and privacy restrictions on data
  • Proficient in containerization technologies, including Docker, and container orchestration with Kubernetes
  • Experience with Terraform, CloudFormation and CDK
  • Experience with Building CICD Frameworks using Jenkins, GitHubActions for Automated Deployments
  • Maintain Git lab Repositories, Handling Releases and Branching activities

WHAT YOU WILL NEED

  • 5+ years as a professional Database Infrastructure engineer with experience in production scale platforms
  • Strong experience with distributed data architectures and big data processing technologies (Spark, EMR, Hadoop, Hive)
  • Strong experience with Configuration Management, Continues integration and DevOps
  • Expert knowledge of AWS Analysis services like Redshift, Glue, Athena, Lake Formation
  • Strong knowledge on Python or similar scripting language
  • Strong experience with Realtime Frameworks, collection, and processing Realtime data using kinesis Data Streams, KCL, KDA and Firehoses
  • Strong understanding of AWS security services including KMS, CloudTrail, STS
  • Strong understanding of Kinesis/Glue frameworks and Spark Streaming for building Realtime analytics
  • Expert in CICD framework, Preferably GitHubActions, Jenkins and GitHub for version controlling
  • Expert knowledge on Blue/Green Deployment for Lambda and Microservices Expert Knowledge on Elastic Containers and Elastic Container Services
  • Discerning appreciation of best practices in designing data lakes/lake houses, mentoring junior members, peer review and recommendation
  • Proven ability to deliver high quality, production ready code
  • Expert understanding of the agile software development life cycle
  • Strong customer service and communication skills (verbal and written) to effectively interact with a diverse team of people across business and engineering
  • Bachelor’s degree in computer science

NICE TO HAVE, BUT NOT A DEALBREAKER

  • Experience with Snowflake and Delta Lake technologies is a plus

  • Data Infrastructure Engineer

    2 months ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Data Infrastructure Engineer

    3 days ago

    Bengaluru, Karnataka, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Data Infrastructure Engineer

    3 days ago

    Bengaluru, Karnataka, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight.You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Data Infrastructure Engineer

    2 weeks ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Data Infrastructure Engineer

    2 months ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Data Infrastructure Engineer

    2 months ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTION As a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Data Infrastructure Engineer

    2 weeks ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTION As a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Cloud Infrastructure Engineer

    1 month ago

    Bengaluru, India Top Talent Technologies Pvt Ltd Full time

    Job Description :- Design, provision, and maintain data infrastructure using cloud-native services (e.g., Amazon MSK, Apache NiFi).- Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration.- Optimize data infrastructure for performance, scalability, and cost-effectiveness.- Monitor and...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Bengaluru, India Top Talent Technologies Pvt Ltd Full time

    Job Description :- Design, provision, and maintain data infrastructure using cloud-native services (e.g., Amazon MSK, Apache NiFi).- Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration.- Optimize data infrastructure for performance, scalability, and cost-effectiveness.- Monitor and...

  • Data Infrastructure Engineer

    2 months ago

    Bengaluru, India Fox Corporation Full time

    OVERVIEW OF THE COMPANYFox CorporationUnder the FOX banner, we produce and distribute content through some of the world’s leading and most valued brands, including: FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations and Tubi Media Group. We empower a diverse range of creators to imagine and develop culturally significant content, while...

  • Infrastructure Engineer

    3 days ago

    Bengaluru, India Silq Full time

    About Silq:SILQ’s core mission is to simplify global trade and create a cost-effective and sustainable supply chain that is accessible to everyone. Thinking about supply chain optimization from first principles, The team in India will focus on building the next generation of tooling for factories and a mobile application to collect quality data from the...

  • AI Data Engineer

    2 months ago

    Bengaluru, India ApicalGo Consultancy Full time

    Primary Purpose :Building and maintaining the company's data infrastructure on the AWS cloud platform, with a specific focus on supporting AI model training, development, and deployment. This includes designing, developing, and implementing data pipelines, ensuring the secure and efficient flow of data for our AI models.Responsibilities :Data for AI...

  • AI Data Engineer

    2 weeks ago

    Bengaluru, India ApicalGo Consultancy Full time

    Primary Purpose :Building and maintaining the company's data infrastructure on the AWS cloud platform, with a specific focus on supporting AI model training, development, and deployment. This includes designing, developing, and implementing data pipelines, ensuring the secure and efficient flow of data for our AI models.Responsibilities :Data for AI...

  • Data Infrastructure Engineer

    2 months ago

    Bengaluru, India Fox Corporation Full time

    OVERVIEW OF THE COMPANY Fox CorporationUnder the FOX banner, we produce and distribute content through some of the world’s leading and most valued brands, including: FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations and Tubi Media Group. We empower a diverse range of creators to imagine and develop culturally significant...

  • Data Infrastructure Engineer

    2 weeks ago

    Bengaluru, India Fox Corporation Full time

    OVERVIEW OF THE COMPANY Fox CorporationUnder the FOX banner, we produce and distribute content through some of the world’s leading and most valued brands, including: FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations and Tubi Media Group. We empower a diverse range of creators to imagine and develop culturally significant...

  • Cloud Infrastructure Engineer

    3 days ago

    Bengaluru, Karnataka, India Top Talent Technologies Pvt Ltd Full time

    Job Description : Design, provision, and maintain data infrastructure using cloudnative services (e.g., Amazon MSK, Apache NiFi). Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration. Optimize data infrastructure for performance, scalability, and costeffectiveness. Monitor and...

  • Infrastructure Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as an Infrastructure EngineerWe'll look to you to develop and implement core infrastructure technologies, products and services against customer and non-functional requirementsIn order to achieve a first-class customer experience, you'll make sure the infrastructure technology is engineered to comply with security, availability and resilience,...

  • Infrastructure Engineer

    1 month ago

    Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as an Infrastructure EngineerWe'll look to you to develop and implement core infrastructure technologies, products and services against customer and non-functional requirementsIn order to achieve a first-class customer experience, you'll make sure the infrastructure technology is engineered to comply with security, availability and resilience,...

  • Infrastructure Engineer

    3 days ago

    Bengaluru, Karnataka, India Silq Full time

    About Silq: SILQ's core mission is to simplify global trade and create a cost-effective and sustainable supply chain that is accessible to everyone.Thinking about supply chain optimization from first principles, The team in India will focus on building the next generation of tooling for factories and a mobile application to collect quality data from the...

  • Sr data engineer

    23 hours ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data engineer  Strong...