Data Infrastructure Engineer

7 days ago


Bengaluru, Karnataka, India Mitchell Martin Inc. Full time

JOB DESCRIPTION

As a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight.

You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated solutions that help bring data to life.

You have experience building and maintaining ETLs, data pipelines, and data models.

Beyond your strong technical skills, you are a collaborator who is a passionate advocate for empowering and enlightening others with the power of data to help turn information into knowledge and actionable insights.


A SNAPSHOT OF YOUR RESPONSIBILITIES
Drive and participate in the definition, the direction, and the development of the Data platform
Work with internal stakeholders, data engineers and data science team to scope the requirements, evaluate business needs and objectives
Design and develop highly scalable, reliable, extensive, and maintainable Data Processing Frameworks
Establish and implement best engineering practices such as architectural design, unit and regression testing, test-driven development, pair programming, and continuous integration frameworks
Assist with process improvement with a customer focused, progressive mindset
Understand data classification and adhere to the information protection and privacy restrictions on data
Proficient in containerization technologies, including Docker, and container orchestration with Kubernetes
Experience with Terraform, Cloud Formation and CDK
Experience with Building CICD Frameworks using Jenkins, Git Hub Actions for Automated Deployments
Maintain Git lab Repositories, Handling Releases and Branching activities

WHAT YOU WILL NEED
5+ years as a professional Database Infrastructure engineer with experience in production scale platforms
Strong experience with distributed data architectures and big data processing technologies (Spark, EMR, Hadoop, Hive)
Strong experience with Configuration Management, Continues integration and Dev Ops
Expert knowledge of AWS Analysis services like Redshift, Glue, Athena, Lake Formation
Strong knowledge on Python or similar scripting language
Strong experience with Realtime Frameworks, collection, and processing Realtime data using kinesis Data Streams, KCL, KDA and Firehoses
Strong understanding of AWS security services including KMS, Cloud Trail, STS
Strong understanding of Kinesis/Glue frameworks and Spark Streaming for building Realtime analytics
Expert in CICD framework, Preferably Git Hub Actions, Jenkins and Git Hub for version controlling
Expert knowledge on Blue/Green Deployment for Lambda and Microservices Expert Knowledge on Elastic Containers and Elastic Container Services
Discerning appreciation of best practices in designing data lakes/lake houses, mentoring junior members, peer review and recommendation
Proven ability to deliver high quality, production ready code
Expert understanding of the agile software development life cycle
Strong customer service and communication skills (verbal and written) to effectively interact with a diverse team of people across business and engineering
Bachelor's degree in computer science
NICE TO HAVE, BUT NOT A DEALBREAKER
Experience with Snowflake and Delta Lake technologies is a plus

  • Bengaluru, Karnataka, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONAs a key member of Data Infrastructure team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only delivery data, but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated...


  • Bengaluru, Karnataka, India Top Talent Technologies Pvt Ltd Full time

    Job Description : Design, provision, and maintain data infrastructure using cloudnative services (e.g., Amazon MSK, Apache NiFi). Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration. Optimize data infrastructure for performance, scalability, and costeffectiveness. Monitor and...


  • Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as an Infrastructure EngineerWe'll look to you to develop and implement core infrastructure technologies, products and services against customer and non-functional requirementsIn order to achieve a first-class customer experience, you'll make sure the infrastructure technology is engineered to comply with security, availability and resilience,...


  • Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as an Infrastructure EngineerWe'll look to you to develop and implement core infrastructure technologies, products and services against customer and non-functional requirementsIn order to achieve a first-class customer experience, you'll make sure the infrastructure technology is engineered to comply with security, availability and resilience,...


  • Bengaluru, Karnataka, India Silq Full time

    About Silq: SILQ's core mission is to simplify global trade and create a cost-effective and sustainable supply chain that is accessible to everyone.Thinking about supply chain optimization from first principles, The team in India will focus on building the next generation of tooling for factories and a mobile application to collect quality data from the...


  • Bengaluru, Karnataka, India Silq Full time

    About Silq:SILQ's core mission is to simplify global trade and create a cost-effective and sustainable supply chain that is accessible to everyone. Thinking about supply chain optimization from first principles, The team in India will focus on building the next generation of tooling for factories and a mobile application to collect quality data from the...

  • Data Engineer

    7 days ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python8 to 13 years of experience in Data engineeringExtensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)Hands-on experience in SnowflakeProficient in Data Pipeline OrchestrationProficient in any one of the programing languages (python or...


  • Bengaluru, Karnataka, India Hclsoftware Full time

    Role: Infrastructure EngineerExp: 8+ years onlyLocation: BangaloreWork Mode: HybridSend resumes to: mounika-.softwareJob Description:We are looking for an experienced Infrastructure Engineer to join our team.The position requires someone with Unix and Windows administration experience, experience building out labs, and who possesses people skills to act as a...


  • Bengaluru, Karnataka, India Kwalee Full time

    Kwalee creates engaging and innovative games that are easy to pick up and play. Specialising in both the development and publishing of casual and hybrid casual games, we also bring our creative touch to publishing PC & Console titles, ensuring a diverse and exciting gaming portfolio. With a focus on fun and creativity we have made a mark in the gaming...


  • Bengaluru, Karnataka, India WELLS FARGO BANK Full time

    About this role:Wells Fargo is looking for a...In this position, you will:Supervise and cultivate Infrastructure Engineers in roles with moderate complexity and riskLead teams in managing Data Center infrastructure and governanceEnsure optimal functioning of Information Technology infrastructurePlan and implement Information Technology infrastructure across...


  • Bengaluru, Karnataka, India HireFlex Full time

    Job Title: Senior Infrastructure Engineer – Windows, and VMwareJob Description:We are in search of a highly experienced Senior Infrastructure Engineer with in-depth knowledge of Windows, Linux, and VMware technologies. This role involves leading the design, implementation, and management of our IT infrastructure to ensure its security, efficiency, and...


  • Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as an Infrastructure EngineerWe'll look to you to develop and implement core infrastructure technologies, products and services against customer and non-functional requirementsIn order to achieve a first-class customer experience, you'll make sure the infrastructure technology is engineered to comply with security, availability and resilience,...


  • Bengaluru, Karnataka, India NatWest Digital X Full time

    Join us as an Infrastructure EngineerWe'll look to you to develop and implement core infrastructure technologies, products and services against customer and non-functional requirementsIn order to achieve a first-class customer experience, you'll make sure the infrastructure technology is engineered to comply with security, availability and resilience,...


  • Bengaluru, Karnataka, India Mindpool Technologies Ltd Full time

    Job DescriptionMap infrastructure objects into the Data Center Infrastructure Management (DCIM) system for monitoring using BACnet, Modbus, OPC and other industry standard communications protocols.Work with local and regional construction teams, equipment vendors and software development team to coordinate DCIM monitoring of site infrastructure.Identify...

  • Data Architect

    7 days ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description: Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at SalesforceWe are seeking a Data Modeler...

  • Data Engineer

    7 days ago


    Bengaluru, Karnataka, India C5i Full time

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing.The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessible, reliabThe Data Engineer will be responsible for designing, building, and...


  • Bengaluru, Karnataka, India Biocon Biologics Full time

    Biocon Biologics is a subsidiary of Biocon Ltd, an innovation led global biopharmaceuticals company. Biocon Biologics is engaged in developing high quality, affordable biosimilars that can expand access to a cutting-edge class of therapies to patients globally. It is uniquely positioned as a fully integrated 'pure play' biosimilars organization in the world...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story of...

  • Data Engineer

    7 days ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or go)...