Data Infrastructure Engineer

6 days ago


bangalore, India Perfectz Digital Full time
Role - Senior Data Infrastructure Enginee r
Contract Position -6-months
Remote working.
Immediate joiners only.
5+ Years of experience
About the role
As a Senior Data Infrastructure engineer, you will work with Data Engineering, Analyst, and Operations teams to build and maintain a secure, scalable, and reliable data platform that powers Lending Club’s Enterprise Data Hub. The position requires a thorough knowledge of public cloud, big data fundamentals, excellent programming skills, experience with relational & non-relational databases, containerization, IAM & networking security, and troubleshooting.
Responsible for building and managing our cloud infrastructure (AWS) with code first mindset.
Design and architect ETL/ELT pipelines running on AWS EMR and Snowflake
Performance tune data pipelines using technologies such as Apache Spark, Hive, and Trino
Write and maintain high-quality code and participate in design discussions and code reviews.
Implement data storage solutions such as S3, ERDS, and NoSQL databases.
Automate workflows using orchestration systems like airflow, oozie etc.
Build monitoring and observability dashboards.
Cost optimization and management.
Enforce security (create and maintain users and roles, assign privileges), establish procedures to ensure data integrity and availability
Perform on-call duties to keep the lights up 24x7.
Setup and maintain documentation and standards.
About you
BS degree in Computer Science or equivalent
5+ years experience on a public cloud such as AWS (preferred), Azure or GCP
Solid programming skills in Java or Python and Shell
Hands-on with Infrastructure as Code tools like Terraform or CloudFormation
Experience with performance diagnostics, debugging and performance tuning.
Familiarity with container software & platforms like Kubernetes, ECS etc.
Excellent verbal, written and interpersonal communication skills.

  • bangalore, India Perfectz Digital Full time

    Role - Senior Data Infrastructure Engineer Contract Position -6-months Remote working. Immediate joiners only. 5+ Years of experienceAbout the roleAs a Senior Data Infrastructure engineer, you will work with Data Engineering, Analyst, and Operations teams to build and maintain a secure, scalable, and reliable data platform that powers Lending Club’s...


  • bangalore, India Perfectz Digital Full time

    Role - Senior Data Infrastructure Enginee r Contract Position -6-months Remote working. Immediate joiners only.  5+ Years of experience About the role As a Senior Data Infrastructure engineer, you will work with Data Engineering, Analyst, and Operations teams to build and maintain a secure, scalable, and reliable data platform that powers Lending...


  • Bangalore, India ApicalGo Consultancy Full time

    Data Infrastructure RoleAbout the PositionApicalGo Consultancy is seeking a highly skilled Data Infrastructure Specialist to support our AI model training and development efforts. In this role, you will be responsible for designing, developing, and maintaining our data infrastructure on the AWS cloud platform.Key ResponsibilitiesDesign and implement data...

  • Principal Engineer

    1 month ago


    Bangalore, Karnataka, India Talpro Full time

    Requirements :JOB DETAIL :We are looking for a bright and exceptional Principal Engineer to join our core infrastructure technology team in Hyderabad.The Team :The Infrastructure team builds and maintains the IT infrastructure which is the foundation of the firm's technology platform. The group builds and manages stable, scalable and secure...

  • Principal Engineer

    4 weeks ago


    Bangalore, India Talpro Full time

    Requirements :JOB DETAIL :We are looking for a bright and exceptional Principal Engineer to join our core infrastructure technology team in Hyderabad.The Team :The Infrastructure team builds and maintains the IT infrastructure which is the foundation of the firm's technology platform. The group builds and manages stable, scalable and secure...


  • Bangalore, India Talent Nexa Consulting Full time

    Job Title: DevOps EngineerWe are seeking a highly skilled DevOps Engineer to join our team at Talent Nexa Consulting. As a DevOps Engineer, you will be responsible for designing, implementing, and maintaining our cloud infrastructure using AWS, Kubernetes, and Docker.Key Responsibilities:Design and implement scalable and secure cloud infrastructure using AWS...

  • Data Engineer

    2 weeks ago


    Bangalore, India Travash Software Solutions Private Limited Full time

    Key Responsibilities :- Manage and optimize Hadoop infrastructure and cluster performance to ensure efficient data processing and storage.- Develop, implement, and maintain ETL and data pipelines within the Hadoop ecosystem, ensuring data quality, governance, and security.- Collaborate with cross-functional teams to design, develop, and deploy data...


  • Bangalore, India InfoPro Solutions Pvt Ltd Full time

    Job Title: Cloud Infrastructure EngineerAbout the Role:As a Cloud Infrastructure Engineer at InfoPro Solutions Pvt Ltd, you will play a critical role in designing, building, and maintaining scalable, reliable, and secure cloud infrastructure solutions. Your expertise will ensure high availability, performance, and cost-efficiency across cloud environments,...

  • Data Engineer

    6 hours ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!! **TCS is Hiring for Azure Databricks Data Engineer ** Walkin Interview for Azure Databricks Data Engineer in Bangalore Walkin Interview Date: 9th Nov 2024(Saturday) Role: Azure Databricks Data Engineer Desired Experience: 4- 8 Years Job Location: Bangalore Job Description: Azure Databricks Data Engineer with Python, PySpark ETL...

  • DevOps Engineer

    1 month ago


    Bangalore, Karnataka, India Workeagle Full time

    Review Criteria :- Strong DevOps Engineer (Cloud, Docker) ProfileMandatory (Experience) - 1+ years of proven experience in DevOps Engineering.Mandatory (Skills 1) - Proficiency in managing any cloud infrastructure (AWS / Azure, Google Cloud)Preferred (Skills 2) - Experience in designing and maintaining data pipelines and ETL processes.Preferred (Skills 3) -...

  • DevOps Engineer

    4 weeks ago


    Bangalore, India Workeagle Full time

    Review Criteria :- Strong DevOps Engineer (Cloud, Docker) ProfileMandatory (Experience) - 1+ years of proven experience in DevOps Engineering.Mandatory (Skills 1) - Proficiency in managing any cloud infrastructure (AWS / Azure, Google Cloud)Preferred (Skills 2) - Experience in designing and maintaining data pipelines and ETL processes.Preferred (Skills 3) -...


  • Bangalore, India Tranzeal Incorporated Full time

    Job Title: Site Reliability EngineerJob Summary:We are seeking a highly skilled Site Reliability Engineer to join our team at Tranzeal Incorporated. As a Site Reliability Engineer, you will be responsible for ensuring the scalability, reliability, and performance of our cloud-based applications.Key Responsibilities:Maintain and scale production services and...

  • Data Engineer

    6 days ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Databricks Data Engineer **Walkin Interview for Azure Databricks Data Engineer in BangaloreWalkin Interview Date: 9th Nov 2024(Saturday)Role: Azure Databricks Data EngineerDesired Experience: 4- 8 YearsJob Location: BangaloreJob Description:- Azure Databricks Data Engineer with Python, PySpark ETL notebook...


  • Bangalore, India Option One Technologies Full time

    Sr Network and Infrastructure Engineer Option One Technologies is a next-generation managed IT and cloud platform that democratizes the best-in-class technology for financial services and institutions. Founded in 2019 by alumni from the Boston-based hedge fund Highfields Capital Management, our mission is to make innovative solutions accessible to all...


  • Bangalore, India Option One Technologies Full time

    Sr Network and Infrastructure Engineer Option One Technologies is a next-generation managed IT and cloud platform that democratizes the best-in-class technology for financial services and institutions. Founded in 2019 by alumni from the Boston-based hedge fund Highfields Capital Management, our mission is to make innovative solutions accessible to all...


  • Bangalore, India NTT DATA Services Full time

    NTT DATA  strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Infrastructure Management and Systems Integration Specialist to join our team in Bangalore, Karnātaka (IN-KA), India...


  • Bangalore, India HyrEzy Talent Solutions Full time

    Key Responsibilities:1. Engineering Planning & Design :- Collaborate with cross-functional teams to design and implement cloud-based solutions that meet business needs.- Develop and maintain cloud infrastructure using cloud computing platforms such as AWS, Google Cloud, or Azure.- Participate in capacity planning, disaster recovery planning, and security...


  • Bangalore, India Arcesium Full time

    Arcesium seeks a talented and motivated Principal Engineer to join our Infrastructure Development team. This person will work and coordinate internal projects and support Engineering Managers. The successful candidate will be responsible for a variety of critical initiatives that will help Arcesium achieve its strategic goals and growth. The...


  • Bangalore, India Thoucentric Technology Pvt. Ltd. Full time

    Job SummaryWe are seeking a highly skilled DevOps Engineer with expertise in AWS and Terraform to manage and improve our cloud infrastructure. As a key member of our team, you will be responsible for building, deploying, and maintaining highly available, scalable, and secure cloud environments.Key ResponsibilitiesDesign, implement, and manage cloud...

  • Data Engineer

    4 weeks ago


    Bangalore, India Prydan Consultancy Full time

    Prydan Consultancy Services: Data EngineerAt Prydan Consultancy Services, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, building, and maintaining our data infrastructure.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various...