Data Infrastructure Engineer

9 hours ago


Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

Job Description

We are seeking a skilled Data Engineer to join our team at Coders Brain Technology Private Limited. As a Data Engineer, you will design, develop, and maintain scalable data pipelines using Amazon Redshift, Python, and AWS.

Key Responsibilities:

  1. Design and implement ETL/ELT pipelines using Python, Apache Airflow, and dbt to extract, transform, and load data from various sources into Amazon Redshift.
  2. Manage and optimize Amazon Redshift clusters to ensure the warehouse can handle large-scale data efficiently.
  3. Develop solutions to integrate external APIs for data ingestion, ensuring proper data extraction, transformation, and integration into our data infrastructure.
  4. Create and maintain scalable data models in Redshift that support analytics and reporting needs, including designing star and snowflake schemas for optimized querying.
  5. Leverage AWS services such as S3, Lambda, EC2, and CloudWatch to build and maintain a scalable and cost-efficient data architecture.
  6. Use dbt to manage and automate SQL transformations, ensuring modular, reusable, and well-documented data transformation logic.
  7. Utilize Apache Airflow to orchestrate and automate data workflows, ensuring reliable data pipelines and scheduled jobs.
  8. Implement and maintain data validation checks and testing frameworks to ensure data integrity, accuracy, and compliance across all data pipelines.

Required Skills & Qualifications:

  • Bachelor's/Master's degree in Computer Science, Engineering, Data Science, or a related field.
  • 3+ years of experience in data engineering with expertise in Amazon Redshift, Python, and AWS.
  • Strong experience with Apache Airflow for workflow scheduling and orchestration.
  • Hands-on experience with dbt (Data Build Tool) for managing SQL transformations and data models.
  • Proficiency in API development and integration, including the use of RESTful APIs for data ingestion.
  • Extensive experience with AWS services such as S3, Lambda, EC2, RDS, and CloudWatch.
  • Expertise in data modeling concepts and designing efficient data structures (e.g., star schemas, snowflake schemas) in a data warehouse environment.
  • Advanced knowledge of SQL for querying and optimizing large datasets in Redshift.
  • Experience building ETL/ELT pipelines and integrating data from multiple sources, including structured and unstructured data.

Estimated Salary: ₹1500000 - ₹2500000 per annum

Benefits:

  • Competitive salary
  • Opportunities for professional growth and development
  • Collaborative and dynamic work environment
  • Flexible working hours
  • Recognition and rewards for outstanding performance


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    We are seeking a Cloud Infrastructure Engineer to join our team in Bangalore, India.About the JobThis role is an exciting opportunity for a highly skilled professional to work with us on designing and managing data storage solutions within BigQuery and integration with other GCP services.Key ResponsibilitiesDesigning and implementing robust data pipelines...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    NTT DATA Services is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We offer an estimated salary of $110,000 per year in Bangalore, India. The salary may vary based on experience and...

  • ML Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA is seeking a skilled ML Engineer - Cloud Infrastructure Specialist to join our team.Estimated Salary: ₹1,200,000 - ₹2,400,000 per annumKey Responsibilities:Design and implement efficient CI/CD pipelines using Vertex AI Pipelines and Cloud Build for automating the entire ML lifecycle on GCP.Develop and manage infrastructure as code...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...


  • Bengaluru, Karnataka, India Ally-eXecutive Full time

    Job OverviewAt Ally-eXecutive, we are seeking a highly skilled Senior Data Infrastructure Engineer to join our team. This role will involve designing and building large-scale data infrastructure using AWS and Azure cloud platforms.About the RoleWe are looking for a seasoned engineer with 10+ years of experience in designing and implementing data...


  • Bengaluru, Karnataka, India Groww Full time

    About Groww">We are a passionate group of people focused on making financial services accessible to every Indian through a multi-product platform. Every day, we help millions of customers take charge of their financial journey.Our company is built around customer obsession. Every product, every design, and every algorithm is executed with the customers'...


  • Bengaluru, Karnataka, India Luxoft Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to lead the development of our market data infrastructure.


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Title:Cloud Infrastructure Expert - Azure NetworkingAbout the Role:NTT DATA is seeking a highly skilled Cloud Infrastructure Expert in Azure Networking to join our team. The ideal candidate will have expertise in designing, implementing, and managing secure, scalable, and reliable network solutions in Azure.Responsibilities:Design and implement network...


  • Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA is a trusted global innovator of business and technology services, serving 75% of the Fortune Global 100.We are committed to helping clients innovate, optimize and transform for long term success.As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our...


  • Bengaluru, Karnataka, India Elevate Global Full time

    About Elevate Global: Elevate Global is a leading innovator in the financial industry, dedicated to providing cutting-edge solutions that empower individuals and businesses globally. Committed to excellence, we combine technology and financial expertise to drive positive change and enhance the financial well-being of our clients.We are seeking an experienced...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job SummaryWe are seeking an IT Infrastructure Manager to join our team. In this role, you will be responsible for operating within a Region/Country or Services function and ensuring service delivery at the highest level.About NTT DATANTT DATA is a global leader in business and technology services, serving 75% of the Fortune Global 100. We invest over $3.6...


  • Bengaluru, Karnataka, India Duronto Technologies Full time

    Job Description:As a skilled Data Infrastructure Specialist at Duronto Technologies, you will collaborate closely with our GenAI experts to design, build, and maintain the data pipelines and infrastructure necessary for developing and deploying powerful GenAI models. Responsibilities:Partner with GenAI Data Scientists to understand their data needs and...


  • Bengaluru, Karnataka, India TMRW House of Brands Full time

    About TMRW House of BrandsWe're a dynamic company pushing the boundaries in the data engineering space. As a Data Engineer at TMRW House of Brands, you'll play a pivotal role in building and maintaining our robust data infrastructure.Salary RangeThe estimated salary for this position is between $120,000 to $180,000 per year, depending on your level of...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: AI Data Science and Engineering LeaderAbout the Role:We are seeking a highly skilled Ai Data Science and Engineering Leader to join our team in Bangalore, India. This is an excellent opportunity for a talented individual to lead our data science and engineering efforts.Responsibilities:Develop and implement traditional machine learning algorithms...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Specialist - BangaloreAbout the Role:We are seeking a highly skilled Data Engineering Specialist to join our team in Bangalore, India. As a key member of our engineering team, you will be responsible for designing and developing high-quality data pipelines using ETL code in Databricks.Key Responsibilities:Develop high-level design...


  • Bengaluru, Karnataka, India Eximietas Design Full time

    Job Description:We are looking for an experienced Data Engineer to join our team at Eximietas Design. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining scalable MongoDB databases.About the Role:Design and implement high-performance MongoDB databases that meet the needs of our growing...


  • Bengaluru, Karnataka, India Impact Analytics Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer for Cloud Infrastructure to join our team at Impact Analytics.About the RoleThis is a key position in our organization, responsible for designing and developing cloud-based data infrastructure that meets the needs of our distributed applications.You will work closely with our development team to...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...


  • Bengaluru, Karnataka, India LinkedIn Full time

    Job Description:We are seeking an experienced Data Infrastructure Manager to join our production Storage Engineering group at LinkedIn.In this highly visible role, you will work with various engineering teams to guide technology and product feature definitions, implementation, and trade-offs. You will also be responsible for designing and developing storage...

  • Lead Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description:We are seeking a skilled Lead Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and implementing high-level design documents, building ETL code in Databricks, and performing unit and system integration testing.Responsibilities:Design and implement high-level...