Data Infrastructure Engineer

1 month ago

Bengaluru, India Mitchell Martin Inc. Full time
JOB DESCRIPTION

As a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated solutions that help bring data to life. You have experience building and maintaining ETLs, data pipelines, and data models. Beyond your strong technical skills, you are a collaborator who is a passionate advocate for empowering and enlightening others with the power of data to help turn information into knowledge and actionable insights.

A SNAPSHOT OF YOUR RESPONSIBILITIES

- Drive and participate in the definition, the direction, and the development of the Data platform- Work with internal stakeholders, data engineers and data science team to scope the requirements, evaluate business needs and objectives- Design and develop highly scalable, reliable, extensive, and maintainable Data Processing Frameworks- Establish and implement best engineering practices such as architectural design, unit and regression testing, test-driven development, pair programming, and continuous integration frameworks- Assist with process improvement with a customer focused, progressive mindset- Understand data classification and adhere to the information protection and privacy restrictions on data- Proficient in containerization technologies, including Docker, and container orchestration with Kubernetes- Experience with Terraform, CloudFormation and CDK- Experience with Building CICD Frameworks using Jenkins, GitHubActions for Automated Deployments- Maintain Git lab Repositories, Handling Releases and Branching activities

WHAT YOU WILL NEED

- 5+ years as a professional Database Infrastructure engineer with experience in production scale platforms- Strong experience with distributed data architectures and big data processing technologies (Spark, EMR, Hadoop, Hive)- Strong experience with Configuration Management, Continues integration and DevOps- Expert knowledge of AWS Analysis services like Redshift, Glue, Athena, Lake Formation- Strong knowledge on Python or similar scripting language- Strong experience with Realtime Frameworks, collection, and processing Realtime data using kinesis Data Streams, KCL, KDA and Firehoses- Strong understanding of AWS security services including KMS, CloudTrail, STS- Strong understanding of Kinesis/Glue frameworks and Spark Streaming for building Realtime analytics- Expert in CICD framework, Preferably GitHubActions, Jenkins and GitHub for version controlling- Expert knowledge on Blue/Green Deployment for Lambda and Microservices Expert Knowledge on Elastic Containers and Elastic Container Services- Discerning appreciation of best practices in designing data lakes/lake houses, mentoring junior members, peer review and recommendation- Proven ability to deliver high quality, production ready code- Expert understanding of the agile software development life cycle- Strong customer service and communication skills (verbal and written) to effectively interact with a diverse team of people across business and engineering- Bachelor’s degree in computer science

NICE TO HAVE, BUT NOT A DEALBREAKER

- Experience with Snowflake and Delta Lake technologies is a plus

  • Data Infrastructure Engineer

    1 month ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Data Infrastructure Engineer

    2 months ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Data Infrastructure Engineer

    2 months ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTION As a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Data Infrastructure Engineer

    2 months ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Bengaluru, India Top Talent Technologies Pvt Ltd Full time

    Job Description :- Design, provision, and maintain data infrastructure using cloud-native services (e.g., Amazon MSK, Apache NiFi).- Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration.- Optimize data infrastructure for performance, scalability, and cost-effectiveness.- Monitor and...

  • Data Infrastructure Engineer

    1 month ago

    Bengaluru, India Fox Corporation Full time

    OVERVIEW OF THE COMPANYFox CorporationUnder the FOX banner, we produce and distribute content through some of the world’s leading and most valued brands, including: FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations and Tubi Media Group. We empower a diverse range of creators to imagine and develop culturally significant content, while...

  • AI Data Engineer

    4 weeks ago

    Bengaluru, India ApicalGo Consultancy Full time

    Primary Purpose :Building and maintaining the company's data infrastructure on the AWS cloud platform, with a specific focus on supporting AI model training, development, and deployment. This includes designing, developing, and implementing data pipelines, ensuring the secure and efficient flow of data for our AI models.Responsibilities :Data for AI...

  • Data Infrastructure Engineer

    2 months ago

    Bengaluru, India Fox Corporation Full time

    OVERVIEW OF THE COMPANY Fox CorporationUnder the FOX banner, we produce and distribute content through some of the world’s leading and most valued brands, including: FOX News Media, FOX Sports, FOX Entertainment, FOX Television Stations and Tubi Media Group. We empower a diverse range of creators to imagine and develop culturally significant...

  • Infrastructure Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as an Infrastructure EngineerWe'll look to you to develop and implement core infrastructure technologies, products and services against customer and non-functional requirementsIn order to achieve a first-class customer experience, you'll make sure the infrastructure technology is engineered to comply with security, availability and resilience,...

  • Infrastructure Engineer

    1 week ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTION As a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...

  • Infrastructure Engineer III

    6 days ago

    Bengaluru, India JPMorgan Chase & Co. Full time

    You belong to the top echelon of talent in your field. At one of the world's most iconic financial institutions, where infrastructure is of paramount importance, you can play a pivotal role.As an Infrastructure Engineer III at JPMorgan Chase within the Infrastructure Platforms team, you utilize strong knowledge of software, applications, and technical...

  • Infrastructure Engineer III

    6 days ago

    Bengaluru, India JPMorgan Chase & Co. Full time

    You belong to the top echelon of talent in your field. At one of the world's most iconic financial institutions, where infrastructure is of paramount importance, you can play a pivotal role. As an Infrastructure Engineer III at JPMorgan Chase within the Infrastructure Platforms team, you utilize strong knowledge of software, applications, and technical...

  • Infrastructure Engineer

    1 week ago

    Bengaluru, India HCLSoftware Full time

    Role: Infrastructure EngineerExp: 8+ years onlyLocation: BangaloreWork Mode: HybridSend resumes to: mounika-d@hcl.softwareJob Description:We are looking for an experienced Infrastructure Engineer to join our team. The position requires someone with Unix and Windows administration experience, experience building out labs, and who possesses people skills to...

  • Infrastructure Engineer

    1 week ago

    Bengaluru, India HCLSoftware Full time

    Role: Infrastructure EngineerExp: 8+ years onlyLocation: BangaloreWork Mode: HybridSend resumes to: mounika-d@hcl.softwareJob Description:We are looking for an experienced Infrastructure Engineer to join our team. The position requires someone with Unix and Windows administration experience, experience building out labs, and who possesses people skills to...

  • Senior Product Manager-Data Infrastructure

    2 months ago

    Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Data Engineer

    1 day ago

    Bengaluru, India C5i Full time

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessible, reliabThe Data Engineer will be responsible for designing, building, and...

  • Infrastructure Engineer, AVP

    4 weeks ago

    Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as an Infrastructure EngineerWe'll look to you to develop and implement core infrastructure technologies, products and services against customer and non-functional requirementsIn order to achieve a first-class customer experience, you'll make sure the infrastructure technology is engineered to comply with security, availability and resilience,...

  • Senior Infrastructure Engineer

    7 days ago

    Bengaluru, India HireFlex Full time

    Job Title: Senior Infrastructure Engineer – Windows, and VMwareJob Description:We are looking for a highly experienced Senior Infrastructure Engineer with a deep understanding of Windows, Linux, and VMware technologies. This position involves leading the design, implementation, and management of our IT infrastructure, ensuring it is secure, efficient, and...

  • Data Center Infrastructure Management- Embedded

    2 weeks ago

    Bengaluru, India Mindpool Technologies Ltd Full time

    Job DescriptionMap infrastructure objects into the Data Center Infrastructure Management (DCIM) system for monitoring using BACnet, Modbus, OPC and other industry standard communications protocols.Work with local and regional construction teams, equipment vendors and software development team to coordinate DCIM monitoring of site infrastructure.Identify...

  • Data Center Infrastructure Management- Embedded

    2 weeks ago

    Bengaluru, India Mindpool Technologies Ltd Full time

    Job DescriptionMap infrastructure objects into the Data Center Infrastructure Management (DCIM) system for monitoring using BACnet, Modbus, OPC and other industry standard communications protocols.Work with local and regional construction teams, equipment vendors and software development team to coordinate DCIM monitoring of site infrastructure.Identify...