Current jobs related to Netscribes - Data Engineer - Python/PySpark - Bengaluru, Karnataka - NETSCRIBES DATA INSIGHTS PRIVATE LIMITED

  • Netscribes - Data Engineer - Python/PySpark

    4 weeks ago

    Bengaluru, Karnataka, India NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

    We are seeking a highly motivated Data Engineer to join our data engineering team at Netscribes Data Insights Private Limited. In this role, you will design and develop scalable data pipelines and solutions leveraging Databricks, Python, PySpark, and SQL.You will work closely with cross-functional teams to ensure clean, high-quality data is available for...

  • Netscribes - Data Engineer - ETL

    4 weeks ago

    Bengaluru, Karnataka, India NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

    Job Summary:We are seeking a skilled Data Engineer to join our team at Netscribes Data Insights Private Limited. The successful candidate will be responsible for designing, developing, and maintaining robust and scalable data pipelines using Python and related technologies.Key Responsibilities:Data Pipeline Development: Design, develop, and maintain data...

  • Netscribes - Data Engineer - ETL

    2 weeks ago

    Bengaluru, Karnataka, India NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

    Responsibilities :- Data Pipeline Development : Design, develop, and maintain robust and scalable data pipelines using Python and related technologies.- ETL/ELT Processes : Implement and optimize ETL/ELT processes to extract, transform, and load data from various sources into data warehouses and data lakes.- Data Modeling and Warehousing : Design and...

  • Python/PySpark Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBee Careers Full time

    As a Data Engineer, you will be responsible for designing and developing scalable data pipelines and solutions using Databricks, Python, PySpark, and SQL.Your Key Responsibilities:Design, build, and maintain reliable and scalable ETL/ELT pipelines using PySpark, SQL, and Databricks.Collaborate with cross-functional teams to ensure clean, high-quality data is...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBee Careers Full time

    We are seeking a highly skilled Data Engineer to design and develop scalable data pipelines and solutions using Databricks, Python, PySpark, and SQL.Key Responsibilities:Design, build, and maintain reliable and scalable ETL/ELT pipelines using PySpark, SQL, and Databricks.Collaborate with cross-functional teams to ensure clean, high-quality data is available...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India beBee Careers Full time

    Job Title: Data Engineer (Python, PySpark, SQL)About the Role:A key member of our team, you will be responsible for utilizing your technical expertise to design and implement data engineering solutions.Responsibilities:1. Experience in IT Development with a strong foundation in Python & Pyspark2. Hands-on experience in database management with a strong...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBee Careers Full time

    Job Title: Data Engineer - Python/PySpark SpecialistSalary:We offer a competitive salary and benefits package to our Data Engineers. We strive to provide a fair compensation for your skills and experience.Job Description:We are looking for an experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing,...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBee Careers Full time

    Data Engineer - Pyspark SpecialistWe are seeking a talented Data Engineer with expertise in Pyspark to join our team. As a Pyspark Specialist, you will be responsible for designing, developing, and maintaining complex data processing systems using Python and PySpark. This role requires strong technical skills and experience working with big data...

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India beBee Careers Full time

    **Job Description:**">We are seeking a skilled Python Developer with expertise in PySpark to develop and optimize data processing applications.">As a key member of our team, you will be responsible for building robust and scalable data processing solutions using Python and PySpark. You will work closely with data engineers, data scientists, and other...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBee Careers Full time

    We are looking for an experienced professional to join our team in a role that involves working with Databricks, Python and PySpark. The ideal candidate will have good knowledge of SQL, experience as a Databrick and PySpark developer and excellent problem solving and troubleshooting expertise.They will analyze existing infrastructure and ETL jobs, ensuring...

Netscribes - Data Engineer - Python/PySpark

4 weeks ago

Bengaluru, Karnataka, India NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

We are seeking a highly motivated Data Engineer to join our data engineering team. In this role, you will design and develop scalable data pipelines and solutions leveraging Databricks, Python, PySpark, and SQL. You'll work closely with cross-functional teams to ensure clean, high-quality data is available for analytics, reporting, and machine learning use :

- Design, build, and maintain reliable and scalable ETL/ELT pipelines using PySpark, SQL, and Databricks.

- Collaborate with data analysts, scientists, and business stakeholders to gather requirements and build data solutions.

- Develop data models and support the creation of data lakes and data warehouses.

- Implement data quality checks, monitoring, and error-handling mechanisms.

- Optimize the performance of data workflows and queries for efficiency and scalability.

- Manage data integrations from diverse sources such as APIs, cloud storage, RDBMS, and flat files.

- Maintain documentation of pipelines, processes, and data flows.

Requirements :

- Proficient in Python with strong knowledge of libraries related to data manipulation (e. g., pandas, pyodbc, pyspark).

- Hands-on experience with PySpark for large-scale data processing.

- Strong command over SQL, including complex joins, window functions, and optimization.

- Experience with Databricks for building notebooks, jobs, and managing clusters.

- Familiarity with data lakehouse concepts, Delta Lake, and data versioning.

- Understanding of data pipeline orchestration tools (e. g., Airflow, Azure Data Factory).

- Good problem-solving skills and the ability to work in a fast-paced environment.

Preferred Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field.

- Experience with cloud platforms like Azure, AWS, or GCP.

- Knowledge of data governance, data cataloging, and metadata management.

- Experience with CI/CD pipelines and version control (Git).

- Exposure to ML pipelines and real-time data processing (Kafka, Spark Streaming) is a plus.

(ref:hirist.tech)