Data Engineer

3 weeks ago

Bengaluru, India Smartgig Technologies Private Limited Full time

Data Engineer (6+ Years Experience)

Location : Bangalore, Hybrid

Availability : Immediate to 15 Days

About the Role :

We are seeking a highly skilled Data Engineer with over 6 years of experience to join our dynamic team in Bangalore. The ideal candidate will have extensive experience with Python and PySpark, along with a strong understanding of data engineering principles. This hybrid role will require both remote and on-site work.

Key Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain robust data pipelines using Python and PySpark.

- Implement ETL processes to ingest and transform large datasets from various sources.

- Optimize data pipelines for performance and scalability.

Data Management :

- Manage and organize large datasets to ensure data integrity and accessibility.

- Implement data quality checks and validation processes.

- Collaborate with data scientists and analysts to support their data requirements.

Data Integration :

- Integrate data from various internal and external sources.

- Ensure seamless data flow across systems and applications.

- Develop APIs for data access and integration.

Performance Tuning :

- Optimize the performance of data pipelines and processing jobs.

- Monitor and troubleshoot issues related to data processing and workflows.

Collaboration & Communication :

- Work closely with cross-functional teams to understand data requirements and deliver solutions.

- Communicate effectively with stakeholders to ensure data solutions meet business needs.

- Document data processes, workflows, and best practices.

Qualifications :

Education :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Experience :

- 6+ years of hands-on experience in data engineering.

- Proven expertise in Python and PySpark.

Technical Skills :

- Strong understanding of data warehousing concepts and technologies.

- Experience with big data technologies (Hadoop, Spark).

- Proficiency in SQL and database management.

- Familiarity with cloud platforms (AWS, GCP, Azure) is a plus.

- Experience with data visualization tools (e.g., Tableau, Power BI) is a plus.

Soft Skills :

- Excellent problem-solving skills and attention to detail.

- Strong analytical and critical thinking abilities.

- Ability to work independently and in a team environment.

- Good communication and interpersonal skills.

Why Join Us :

- Competitive salary and benefits package.

- Opportunity to work with cutting-edge technologies.

- Collaborative and innovative work environment.

- Career growth and development opportunities.

- Flexible working arrangements.

If you are passionate about data engineering and meet the above requirements, we would love to hear from you. Please apply with your updated resume and a brief cover letter outlining your relevant experience and availability.

(ref:hirist.tech)

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python8 to 13 years of experience in Data engineeringExtensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)Hands-on experience in SnowflakeProficient in Data Pipeline OrchestrationProficient in any one of the programing languages (python or...

  • Senior Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...

  • Senior Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story of...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or go)...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...

  • Senior Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Sr data engineer

    4 days ago

    Bengaluru, India NTT DATA Services Full time

    Req ID:286326NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data engineerStrong...

  • Sr data engineer

    5 days ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data engineer  Strong...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionAzure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years’ experience...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on Apache Spark or...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years' experience on Apache Spark or Azure...

  • Senior Data Engineering Lead

    3 days ago

    Bengaluru, India NTT DATA Services Full time

    Lead Data Engineering Project Team,Expertise in Databricks,Expertise in Azure Cloud and its services,Experienced in Healthcare projects,Experience implementing FHIR Data model and FHIR Server

  • Senior Data Engineering Lead

    7 days ago

    Bengaluru, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Azure Cloud and its services, Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Data Architect

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description: Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at SalesforceWe are seeking a Data Modeler...

  • Data Architect

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description: Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at Salesforce!We are seeking a Data Modeler...

  • Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python• 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages...

  • Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python• 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages...