Data Engineer

2 weeks ago

Bengaluru, India Coders Brain Technology Private Limited Full time

We are looking for a talented Data Engineer with experience in ETL processes, database administration, and scripting, as well as expertise in tools such as Snowflake, Azure Data Factory, DBT, and Talend. The ideal candidate will have a strong technical background and be capable of working on various aspects of data engineering, from building data pipelines to optimizing data storage and retrieval.

Key Responsibilities :

ETL Development and Maintenance :

- Design, develop, and maintain scalable ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes.

- Utilize Talend and Azure Data Factory to create and manage ETL workflows that ensure data accuracy and efficiency.

Database Administration :

- Administer and optimize databases, ensuring high performance, availability, and security of data assets.

- Manage Snowflake data warehouse, including schema design, data partitioning, and performance tuning.

Data Engineering and Scripting :

- Develop and maintain Python scripts for data processing, automation, and integration tasks.

- Implement and optimize data transformation processes using DBT (Data Build Tool) to ensure data quality and consistency.

Data Integration and Management :

- Integrate data from multiple sources and ensure seamless data flow and accessibility.

- Collaborate with data analysts and data scientists to understand data requirements and deliver relevant solutions.

Performance Optimization :

- Monitor and optimize data pipelines and database performance to ensure efficient data processing and retrieval.

- Troubleshoot and resolve issues related to data pipelines, database operations, and data quality.

Documentation and Best Practices :

- Document data engineering processes, workflows, and architecture to support knowledge sharing and maintenance.

- Implement best practices for data engineering, including data governance, version control, and code review.

Collaboration and Communication :

- Work closely with cross-functional teams to gather requirements, provide updates, and ensure alignment on data engineering projects.

- Communicate technical concepts and solutions effectively to both technical and non-technical stakeholders.

Qualifications :

Education & Experience :

- Bachelor's degree in Computer Science, Data Engineering, or a related field. Advanced degree preferred.

- Minimum of 5 years of experience in data engineering or a similar role, with hands-on experience in ETL processes and database administration.

Technical Skills :

- Proficiency in ETL tools such as Talend and Azure Data Factory.

- Experience with Snowflake data warehouse platform.

- Strong scripting skills in Python for data processing and automation.

- Knowledge of DBT (Data Build Tool) for data transformation and modelling.

- Experience with database administration, performance tuning, and optimization.

Additional Skills :

- Familiarity with cloud platforms (e.g., Azure, AWS, Google Cloud) is a plus.

- Strong problem-solving skills and attention to detail.

- Ability to work independently and as part of a team in a fast-paced environment.

- Excellent communication and interpersonal skills.

(ref:hirist.tech)

  • Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 301314 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: As a data...

  • Data Engineering Expert

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will play a crucial role in designing and implementing automated data pipelines.

  • Data Engineer

    1 month ago

    Bengaluru, India NTT DATA Full time

    Job Description Mandatory Skills and Qualifications:Snowflake: Proven experience in using Snowflake for data warehousing solutions.Databricks: Strong hands-on experience with Databricks for big data processing and analytics using Machine Learning.Redshift: Expertise in managing and optimizing Amazon Redshift data warehouses.Spark: Advanced knowledge of...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 302206 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job...

  • Data Engineering Cloud Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...

  • Databricks Data Engineer

    1 month ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 301996 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Databricks Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Key...

  • Data Engineering Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Requirements:NTT DATA Services is seeking a skilled Data Engineer to join our team in Bangalore, India. In this role, you will work closely with the GenAI architect to design and implement automated data pipelines.Key Responsibilities:Analyze and understand source data, preparing and managing data sets for actionable insights.Collaborate with Data...

  • Data Engineering Specialist

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Specialist - BangaloreAbout the Role:We are seeking a highly skilled Data Engineering Specialist to join our team in Bangalore, India. As a key member of our engineering team, you will be responsible for designing and developing high-quality data pipelines using ETL code in Databricks.Key Responsibilities:Develop high-level design...

  • Cloud Data Engineer for Big Data Solutions

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...

  • Senior Data Engineering Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Senior Data Engineering Specialist to join our team in Bangalore, India. The successful candidate will have a strong background in ETL development and data engineering using Azure concepts and technologies.Key ResponsibilitiesDesign and implement high and low-level design documents for ETL processes.Develop ETL code in...

  • Snowflake Data Engineer and Architect

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...

  • AI Data Science and Engineering Leader

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: AI Data Science and Engineering LeaderAbout the Role:We are seeking a highly skilled Ai Data Science and Engineering Leader to join our team in Bangalore, India. This is an excellent opportunity for a talented individual to lead our data science and engineering efforts.Responsibilities:Develop and implement traditional machine learning algorithms...

  • AI Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Job Title: Data Science & AIML, GenAI Lead/EngineerKey Responsibilities:• Develop and implement traditional machine learning algorithms.• Deploy at least one model in a production environment.• Write and maintain Python code for data science and machine learning projects.Preferred Qualifications:• Knowledge of Deep Learning (DL)...

  • Sr. Data Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 302055 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr. Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Build data...

  • Cloud Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...

  • Hevo Data

    1 month ago

    Bengaluru, India HEVO DATA Full time

    This role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...

  • Data Engineering Senior Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineering Senior Specialist RoleDiverse and dynamic Data Engineering activities on Azure Data platform. The role involves building and delivering Data pipelines connecting various enterprise data sources, both RDBMS and NoSQL. Develop data mappings to existing data sources and design big data processing notebooks using Azure Databricks. Scripting and...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 302206 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job PurposeThe senior data...

  • Data Engineer for Cloud Migration and Data Pipelining Expert

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. This role involves designing, building, and maintaining scalable data pipelines using Databricks on AWS.The ideal candidate will have experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development....

  • Power BI Data Engineer

    1 month ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 296408 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Power BI Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Must...