Data Infrastructure Engineer
9 hours ago
Job Description
We are seeking a skilled Data Engineer to join our team at Coders Brain Technology Private Limited. As a Data Engineer, you will design, develop, and maintain scalable data pipelines using Amazon Redshift, Python, and AWS.
Key Responsibilities:
- Design and implement ETL/ELT pipelines using Python, Apache Airflow, and dbt to extract, transform, and load data from various sources into Amazon Redshift.
- Manage and optimize Amazon Redshift clusters to ensure the warehouse can handle large-scale data efficiently.
- Develop solutions to integrate external APIs for data ingestion, ensuring proper data extraction, transformation, and integration into our data infrastructure.
- Create and maintain scalable data models in Redshift that support analytics and reporting needs, including designing star and snowflake schemas for optimized querying.
- Leverage AWS services such as S3, Lambda, EC2, and CloudWatch to build and maintain a scalable and cost-efficient data architecture.
- Use dbt to manage and automate SQL transformations, ensuring modular, reusable, and well-documented data transformation logic.
- Utilize Apache Airflow to orchestrate and automate data workflows, ensuring reliable data pipelines and scheduled jobs.
- Implement and maintain data validation checks and testing frameworks to ensure data integrity, accuracy, and compliance across all data pipelines.
Required Skills & Qualifications:
- Bachelor's/Master's degree in Computer Science, Engineering, Data Science, or a related field.
- 3+ years of experience in data engineering with expertise in Amazon Redshift, Python, and AWS.
- Strong experience with Apache Airflow for workflow scheduling and orchestration.
- Hands-on experience with dbt (Data Build Tool) for managing SQL transformations and data models.
- Proficiency in API development and integration, including the use of RESTful APIs for data ingestion.
- Extensive experience with AWS services such as S3, Lambda, EC2, RDS, and CloudWatch.
- Expertise in data modeling concepts and designing efficient data structures (e.g., star schemas, snowflake schemas) in a data warehouse environment.
- Advanced knowledge of SQL for querying and optimizing large datasets in Redshift.
- Experience building ETL/ELT pipelines and integrating data from multiple sources, including structured and unstructured data.
Estimated Salary: ₹1500000 - ₹2500000 per annum
Benefits:
- Competitive salary
- Opportunities for professional growth and development
- Collaborative and dynamic work environment
- Flexible working hours
- Recognition and rewards for outstanding performance
-
Cloud Infrastructure Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeWe are seeking a Cloud Infrastructure Engineer to join our team in Bangalore, India.About the JobThis role is an exciting opportunity for a highly skilled professional to work with us on designing and managing data storage solutions within BigQuery and integration with other GCP services.Key ResponsibilitiesDesigning and implementing robust data pipelines...
-
Cloud Infrastructure Engineer
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeNTT DATA Services is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We offer an estimated salary of $110,000 per year in Bangalore, India. The salary may vary based on experience and...
-
ML Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob OverviewNTT DATA is seeking a skilled ML Engineer - Cloud Infrastructure Specialist to join our team.Estimated Salary: ₹1,200,000 - ₹2,400,000 per annumKey Responsibilities:Design and implement efficient CI/CD pipelines using Vertex AI Pipelines and Cloud Build for automating the entire ML lifecycle on GCP.Develop and manage infrastructure as code...
-
Cloud Data Engineer for Big Data Solutions
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...
-
Senior Data Infrastructure Engineer
3 weeks ago
Bengaluru, Karnataka, India Ally-eXecutive Full timeJob OverviewAt Ally-eXecutive, we are seeking a highly skilled Senior Data Infrastructure Engineer to join our team. This role will involve designing and building large-scale data infrastructure using AWS and Azure cloud platforms.About the RoleWe are looking for a seasoned engineer with 10+ years of experience in designing and implementing data...
-
Data Engineering Infrastructure Specialist
4 weeks ago
Bengaluru, Karnataka, India Groww Full timeAbout Groww">We are a passionate group of people focused on making financial services accessible to every Indian through a multi-product platform. Every day, we help millions of customers take charge of their financial journey.Our company is built around customer obsession. Every product, every design, and every algorithm is executed with the customers'...
-
Data Engineer for Market Data Infrastructure
2 weeks ago
Bengaluru, Karnataka, India Luxoft Full timeJob OverviewWe are seeking a highly skilled Data Engineer to lead the development of our market data infrastructure.
-
Cloud Infrastructure Expert
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Title:Cloud Infrastructure Expert - Azure NetworkingAbout the Role:NTT DATA is seeking a highly skilled Cloud Infrastructure Expert in Azure Networking to join our team. The ideal candidate will have expertise in designing, implementing, and managing secure, scalable, and reliable network solutions in Azure.Responsibilities:Design and implement network...
-
IT Infrastructure Specialist
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeNTT DATA is a trusted global innovator of business and technology services, serving 75% of the Fortune Global 100.We are committed to helping clients innovate, optimize and transform for long term success.As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our...
-
Chief Data Infrastructure Engineer
1 week ago
Bengaluru, Karnataka, India Elevate Global Full timeAbout Elevate Global: Elevate Global is a leading innovator in the financial industry, dedicated to providing cutting-edge solutions that empower individuals and businesses globally. Committed to excellence, we combine technology and financial expertise to drive positive change and enhance the financial well-being of our clients.We are seeking an experienced...
-
IT Infrastructure Manager
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob SummaryWe are seeking an IT Infrastructure Manager to join our team. In this role, you will be responsible for operating within a Region/Country or Services function and ensuring service delivery at the highest level.About NTT DATANTT DATA is a global leader in business and technology services, serving 75% of the Fortune Global 100. We invest over $3.6...
-
Data Infrastructure Specialist
4 weeks ago
Bengaluru, Karnataka, India Duronto Technologies Full timeJob Description:As a skilled Data Infrastructure Specialist at Duronto Technologies, you will collaborate closely with our GenAI experts to design, build, and maintain the data pipelines and infrastructure necessary for developing and deploying powerful GenAI models. Responsibilities:Partner with GenAI Data Scientists to understand their data needs and...
-
Bengaluru, Karnataka, India TMRW House of Brands Full timeAbout TMRW House of BrandsWe're a dynamic company pushing the boundaries in the data engineering space. As a Data Engineer at TMRW House of Brands, you'll play a pivotal role in building and maintaining our robust data infrastructure.Salary RangeThe estimated salary for this position is between $120,000 to $180,000 per year, depending on your level of...
-
AI Data Science and Engineering Leader
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Title: AI Data Science and Engineering LeaderAbout the Role:We are seeking a highly skilled Ai Data Science and Engineering Leader to join our team in Bangalore, India. This is an excellent opportunity for a talented individual to lead our data science and engineering efforts.Responsibilities:Develop and implement traditional machine learning algorithms...
-
Data Engineering Specialist
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Title: Data Engineering Specialist - BangaloreAbout the Role:We are seeking a highly skilled Data Engineering Specialist to join our team in Bangalore, India. As a key member of our engineering team, you will be responsible for designing and developing high-quality data pipelines using ETL code in Databricks.Key Responsibilities:Develop high-level design...
-
Data Engineer for MongoDB Infrastructure
6 days ago
Bengaluru, Karnataka, India Eximietas Design Full timeJob Description:We are looking for an experienced Data Engineer to join our team at Eximietas Design. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining scalable MongoDB databases.About the Role:Design and implement high-performance MongoDB databases that meet the needs of our growing...
-
Data Engineer for Cloud Infrastructure
2 weeks ago
Bengaluru, Karnataka, India Impact Analytics Full timeJob DescriptionWe are seeking a highly skilled Data Engineer for Cloud Infrastructure to join our team at Impact Analytics.About the RoleThis is a key position in our organization, responsible for designing and developing cloud-based data infrastructure that meets the needs of our distributed applications.You will work closely with our development team to...
-
Snowflake Data Engineer and Architect
4 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...
-
Data Infrastructure Manager
4 weeks ago
Bengaluru, Karnataka, India LinkedIn Full timeJob Description:We are seeking an experienced Data Infrastructure Manager to join our production Storage Engineering group at LinkedIn.In this highly visible role, you will work with various engineering teams to guide technology and product feature definitions, implementation, and trade-offs. You will also be responsible for designing and developing storage...
-
Lead Data Engineer
4 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Description:We are seeking a skilled Lead Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and implementing high-level design documents, building ETL code in Databricks, and performing unit and system integration testing.Responsibilities:Design and implement high-level...