Data Infrastructure Engineer
6 days ago
Contract Position -6-months
Remote working.
Immediate joiners only.
5+ Years of experience
About the role
As a Senior Data Infrastructure engineer, you will work with Data Engineering, Analyst, and Operations teams to build and maintain a secure, scalable, and reliable data platform that powers Lending Club’s Enterprise Data Hub. The position requires a thorough knowledge of public cloud, big data fundamentals, excellent programming skills, experience with relational & non-relational databases, containerization, IAM & networking security, and troubleshooting.
Responsible for building and managing our cloud infrastructure (AWS) with code first mindset.
Design and architect ETL/ELT pipelines running on AWS EMR and Snowflake
Performance tune data pipelines using technologies such as Apache Spark, Hive, and Trino
Write and maintain high-quality code and participate in design discussions and code reviews.
Implement data storage solutions such as S3, ERDS, and NoSQL databases.
Automate workflows using orchestration systems like airflow, oozie etc.
Build monitoring and observability dashboards.
Cost optimization and management.
Enforce security (create and maintain users and roles, assign privileges), establish procedures to ensure data integrity and availability
Perform on-call duties to keep the lights up 24x7.
Setup and maintain documentation and standards.
About you
BS degree in Computer Science or equivalent
5+ years experience on a public cloud such as AWS (preferred), Azure or GCP
Solid programming skills in Java or Python and Shell
Hands-on with Infrastructure as Code tools like Terraform or CloudFormation
Experience with performance diagnostics, debugging and performance tuning.
Familiarity with container software & platforms like Kubernetes, ECS etc.
Excellent verbal, written and interpersonal communication skills.
-
Data Infrastructure Engineer
6 days ago
bangalore, India Perfectz Digital Full timeRole - Senior Data Infrastructure Engineer Contract Position -6-months Remote working. Immediate joiners only. 5+ Years of experienceAbout the roleAs a Senior Data Infrastructure engineer, you will work with Data Engineering, Analyst, and Operations teams to build and maintain a secure, scalable, and reliable data platform that powers Lending Club’s...
-
Data Infrastructure Engineer
6 days ago
bangalore, India Perfectz Digital Full timeRole - Senior Data Infrastructure Enginee r Contract Position -6-months Remote working. Immediate joiners only. 5+ Years of experience About the role As a Senior Data Infrastructure engineer, you will work with Data Engineering, Analyst, and Operations teams to build and maintain a secure, scalable, and reliable data platform that powers Lending...
-
Data Infrastructure Specialist
2 weeks ago
Bangalore, India ApicalGo Consultancy Full timeData Infrastructure RoleAbout the PositionApicalGo Consultancy is seeking a highly skilled Data Infrastructure Specialist to support our AI model training and development efforts. In this role, you will be responsible for designing, developing, and maintaining our data infrastructure on the AWS cloud platform.Key ResponsibilitiesDesign and implement data...
-
Principal Engineer
1 month ago
Bangalore, Karnataka, India Talpro Full timeRequirements :JOB DETAIL :We are looking for a bright and exceptional Principal Engineer to join our core infrastructure technology team in Hyderabad.The Team :The Infrastructure team builds and maintains the IT infrastructure which is the foundation of the firm's technology platform. The group builds and manages stable, scalable and secure...
-
Principal Engineer
4 weeks ago
Bangalore, India Talpro Full timeRequirements :JOB DETAIL :We are looking for a bright and exceptional Principal Engineer to join our core infrastructure technology team in Hyderabad.The Team :The Infrastructure team builds and maintains the IT infrastructure which is the foundation of the firm's technology platform. The group builds and manages stable, scalable and secure...
-
Cloud Infrastructure Engineer
3 weeks ago
Bangalore, India Talent Nexa Consulting Full timeJob Title: DevOps EngineerWe are seeking a highly skilled DevOps Engineer to join our team at Talent Nexa Consulting. As a DevOps Engineer, you will be responsible for designing, implementing, and maintaining our cloud infrastructure using AWS, Kubernetes, and Docker.Key Responsibilities:Design and implement scalable and secure cloud infrastructure using AWS...
-
Data Engineer
2 weeks ago
Bangalore, India Travash Software Solutions Private Limited Full timeKey Responsibilities :- Manage and optimize Hadoop infrastructure and cluster performance to ensure efficient data processing and storage.- Develop, implement, and maintain ETL and data pipelines within the Hadoop ecosystem, ensuring data quality, governance, and security.- Collaborate with cross-functional teams to design, develop, and deploy data...
-
Cloud Infrastructure Engineer
2 weeks ago
Bangalore, India InfoPro Solutions Pvt Ltd Full timeJob Title: Cloud Infrastructure EngineerAbout the Role:As a Cloud Infrastructure Engineer at InfoPro Solutions Pvt Ltd, you will play a critical role in designing, building, and maintaining scalable, reliable, and secure cloud infrastructure solutions. Your expertise will ensure high availability, performance, and cost-efficiency across cloud environments,...
-
Data Engineer
6 hours ago
bangalore, India Tata Consultancy Services Full timeGreetings from TCS!!! **TCS is Hiring for Azure Databricks Data Engineer ** Walkin Interview for Azure Databricks Data Engineer in Bangalore Walkin Interview Date: 9th Nov 2024(Saturday) Role: Azure Databricks Data Engineer Desired Experience: 4- 8 Years Job Location: Bangalore Job Description: Azure Databricks Data Engineer with Python, PySpark ETL...
-
DevOps Engineer
1 month ago
Bangalore, Karnataka, India Workeagle Full timeReview Criteria :- Strong DevOps Engineer (Cloud, Docker) ProfileMandatory (Experience) - 1+ years of proven experience in DevOps Engineering.Mandatory (Skills 1) - Proficiency in managing any cloud infrastructure (AWS / Azure, Google Cloud)Preferred (Skills 2) - Experience in designing and maintaining data pipelines and ETL processes.Preferred (Skills 3) -...
-
DevOps Engineer
4 weeks ago
Bangalore, India Workeagle Full timeReview Criteria :- Strong DevOps Engineer (Cloud, Docker) ProfileMandatory (Experience) - 1+ years of proven experience in DevOps Engineering.Mandatory (Skills 1) - Proficiency in managing any cloud infrastructure (AWS / Azure, Google Cloud)Preferred (Skills 2) - Experience in designing and maintaining data pipelines and ETL processes.Preferred (Skills 3) -...
-
Cloud Infrastructure Engineer
3 weeks ago
Bangalore, India Tranzeal Incorporated Full timeJob Title: Site Reliability EngineerJob Summary:We are seeking a highly skilled Site Reliability Engineer to join our team at Tranzeal Incorporated. As a Site Reliability Engineer, you will be responsible for ensuring the scalability, reliability, and performance of our cloud-based applications.Key Responsibilities:Maintain and scale production services and...
-
Data Engineer
6 days ago
bangalore, India Tata Consultancy Services Full timeGreetings from TCS!!!**TCS is Hiring for Azure Databricks Data Engineer **Walkin Interview for Azure Databricks Data Engineer in BangaloreWalkin Interview Date: 9th Nov 2024(Saturday)Role: Azure Databricks Data EngineerDesired Experience: 4- 8 YearsJob Location: BangaloreJob Description:- Azure Databricks Data Engineer with Python, PySpark ETL notebook...
-
Sr. Network and Infrastructure Engineer
3 weeks ago
Bangalore, India Option One Technologies Full timeSr Network and Infrastructure Engineer Option One Technologies is a next-generation managed IT and cloud platform that democratizes the best-in-class technology for financial services and institutions. Founded in 2019 by alumni from the Boston-based hedge fund Highfields Capital Management, our mission is to make innovative solutions accessible to all...
-
Sr. network and infrastructure engineer
3 weeks ago
Bangalore, India Option One Technologies Full timeSr Network and Infrastructure Engineer Option One Technologies is a next-generation managed IT and cloud platform that democratizes the best-in-class technology for financial services and institutions. Founded in 2019 by alumni from the Boston-based hedge fund Highfields Capital Management, our mission is to make innovative solutions accessible to all...
-
Bangalore, India NTT DATA Services Full timeNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Infrastructure Management and Systems Integration Specialist to join our team in Bangalore, Karnātaka (IN-KA), India...
-
Cloud Infrastructure Engineer
3 weeks ago
Bangalore, India HyrEzy Talent Solutions Full timeKey Responsibilities:1. Engineering Planning & Design :- Collaborate with cross-functional teams to design and implement cloud-based solutions that meet business needs.- Develop and maintain cloud infrastructure using cloud computing platforms such as AWS, Google Cloud, or Azure.- Participate in capacity planning, disaster recovery planning, and security...
-
Principal engineer- linux
3 weeks ago
Bangalore, India Arcesium Full timeArcesium seeks a talented and motivated Principal Engineer to join our Infrastructure Development team. This person will work and coordinate internal projects and support Engineering Managers. The successful candidate will be responsible for a variety of critical initiatives that will help Arcesium achieve its strategic goals and growth. The...
-
AWS Cloud Infrastructure Engineer
3 weeks ago
Bangalore, India Thoucentric Technology Pvt. Ltd. Full timeJob SummaryWe are seeking a highly skilled DevOps Engineer with expertise in AWS and Terraform to manage and improve our cloud infrastructure. As a key member of our team, you will be responsible for building, deploying, and maintaining highly available, scalable, and secure cloud environments.Key ResponsibilitiesDesign, implement, and manage cloud...
-
Data Engineer
4 weeks ago
Bangalore, India Prydan Consultancy Full timePrydan Consultancy Services: Data EngineerAt Prydan Consultancy Services, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, building, and maintaining our data infrastructure.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various...