ai - Data Engineer - Python/PySpark

2 weeks ago

Pune, Maharashtra, India DataVerze Full time

About DataVerze :

DataVerze is a leading provider of cutting-edge services in GenerativeAI, Machine Learning, and Datamesh. With a strong commitment to innovation and expertise in advanced technologies, we empower businesses to unlock the true potential of their data.

Our team of seasoned professionals brings decades of experience in the field, ensuring that we deliver tailored solutions to meet your specific needs. Through our GenerativeAI services, we enable organizations to create intelligent and interactive systems, driving innovation and enhancing customer experiences.

Leveraging the power of Machine Learning, we develop sophisticated models and algorithms that extract valuable insights from complex datasets, enabling data-driven decision-making.

Our Datamesh approach enables seamless connectivity and collaboration across disparate data sources, revolutionizing how organizations handle and utilize data. Partner with us to embark on a transformative journey fueled by GenerativeAI, Machine Learning, and Datamesh technologies.

Job Description :

We are seeking a skilled Data Engineer to be a part of our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure. You will collaborate closely with data scientists, analysts, and other stakeholders to ensure efficient data processing and :

Optimize Data Workflow : Identify and implement optimization techniques to improve data processing efficiency, performance, and reliability.

Data Modeling : Design and implement data models for efficient storage and retrieval of data, ensuring data integrity and consistency.

Implement Data Security Measures : Implement security measures to safeguard sensitive data and ensure compliance with relevant regulations (e.g., GDPR, HIPAA).

Collaborate with Cross-Functional Teams : Work closely with data scientists, analysts, and other stakeholders to understand their data requirements and provide technical solutions to meet their needs.

Troubleshooting and Debugging : Identify and resolve issues related to data quality, performance, and scalability in a timely manner.

Documentation : Document data pipelines, workflows, and processes to ensure knowledge sharing and :

Bachelor's Degree in Computer Science, Engineering, or related field.

3-5 years of experience as a Data Engineer or similar role.

Proficiency in Python for data processing and scripting.

Experience with Apache Spark or PySpark for distributed data processing.

Solid understanding of AWS services, particularly AWS Glue, S3, EC2, and EMR.

Experience with SQL and NoSQL databases. Strong problem-solving skills and attention to detail.

Excellent communication and collaboration skills. Ability to work effectively in a fast-paced, dynamic environment.

This role offers a hybrid work mode, providing flexibility while still fostering collaboration and innovation.

)

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Overture Rede Private Limited. Full time

    Description:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Overture Rede Private Limited. Full time

    Description:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the...

  • Deloitte - Data Engineer - PySpark/Python

    2 weeks ago

    Pune, Maharashtra, India Deloitte India Full time

    Job Description : - Software design, Scala & Spark, PySpark & Python development, automated testing of new and existing components in an Agile, DevOps and dynamic environment Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale,...

  • Python PySpark Developer

    2 weeks ago

    Pune, Maharashtra, India Synechron Full time

    Python PySpark Developer Exp : 5 - 8 yrs Loc: Pune Notice: 0 -15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization...

  • Deloitte - Data Engineer - PySpark/Python

    1 month ago

    Pune, Maharashtra, India Deloitte India Full time

    Job Description : - Software design, Scala & Spark, PySpark & Python development, automated testing of new and existing components in an Agile, DevOps and dynamic environment Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting.- Implement the tools and processes, handling performance, scale,...

  • Deloitte - Data Engineer - PySpark/Python

    4 weeks ago

    Pune, Maharashtra, India Deloitte India Full time

    Job Description : - Software design, Scala & Spark, PySpark & Python development, automated testing of new and existing components in an Agile, DevOps and dynamic environment Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting.- Implement the tools and processes, handling performance, scale,...

  • Python PySpark Developer

    2 weeks ago

    Pune, Maharashtra, India Synechron Full time

    Python PySpark Developer Exp : 5 - 8 yrs Loc: Pune Notice: 0 -15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization...

  • Python PySpark Developer

    2 weeks ago

    Pune, Maharashtra, India Synechron Full time

    Python PySpark DeveloperExp : 5 - 8 yrsLoc: PuneNotice: 0 -15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...

  • Python PySpark Developer

    2 weeks ago

    Pune, Maharashtra, India Synechron Full time

    Python PySpark DeveloperExp : - 8 yrsLoc: PuneNotice: 0 -15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...

  • Python Developer

    2 months ago

    Pune, Maharashtra, India ADVANSOFT Full time

    Position: Python DeveloperLocation: PuneExperience: 5-8 yearsJob Description:As a Python Developer, you will be responsible for leveraging your expertise in Python, Pyspark, SQL, and Data Structures to develop and maintain high-quality software solutions. Your primary focus will be on designing, implementing, and optimizing Python-based applications and data...

  • Python Developer

    4 weeks ago

    Pune, Maharashtra, India Advansoft Full time

    Position: Python DeveloperLocation: PuneExperience: 5-8 yearsJob Description:As a Python Developer, you will be responsible for leveraging your expertise in Python, Pyspark, SQL, and Data Structures to develop and maintain high-quality software solutions. Your primary focus will be on designing, implementing, and optimizing Python-based applications and data...

  • Data Engineer PySpark AWS

    2 weeks ago

    Pune, Maharashtra, India Fusemachines Full time

    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 450 full-time employees)....

  • Python Pyspark- Application lead

    2 weeks ago

    Pune, Maharashtra, India PURVIEW Full time

    Role: Python Pyspark- Application leadLocation: Pune Look for 6+years experience profilesLooking for only Immediate Joiners. Job Description: As an Application Lead, you will be responsible for designing, building, and configuring applications. Your typical day will involve working with PySpark, Python on Azure, and PostgreSQL to lead the effort and act as...

  • Python with Azure Data Bricks Snowflakes

    2 weeks ago

    Pune, Maharashtra, India 2coms Full time

    Looking ForAzure Data Engineer With Python Professionals For Global IT MNC GreetingsFrom 2COMSGroup Location Pune/Mumbai/Hyderabad/Bangalore/ChennaiYearsof Experience: 5 10YearsMustHave:Azure Data Engineer Python JobDescription: Any Project specificPrerequisite skillsPython ADBADFPyspark and SnowflakeExpectingPython ADBADF Pyspark andSnowflakeLooking For...

  • DataVerze.ai - Data Engineer - Python/PySpark

    3 weeks ago

    Pune, Maharashtra, India DataVerze.ai Full time

    About DataVerze : DataVerze is a leading provider of cutting-edge services in GenerativeAI, Machine Learning, and Datamesh. With a strong commitment to innovation and expertise in advanced technologies, we empower businesses to unlock the true potential of their data.Our team of seasoned professionals brings decades of experience in the field, ensuring that...

  • Python Developer

    2 weeks ago

    Pune, Maharashtra, India IT Full time

    Total Yrs. of Experience : 8+ Relevant Yrs of experience.Roles and Responsibilities :- 5+ years of hands-on Python development experience with excellent programming skills- 3+ years of experience with cloud-based platform, ideally Microsoft Azure- Working experience and skills on big data technologies such as PySpark, Databricks, Kafka- Strong solution...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India PURVIEW Full time

    Purview is hiring Data Engineer with one of our valued clients. If you're interested, please reply for more details. Job Details:Role: Data EngineerLocation: Pune/HyderabadDuration: Permanent with PurviewWe are looking for 5+ years with Python/PySpark Job Description:Design and implement data processing pipelines using Python/Pyspark programming and big data...

  • Senior Python/Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position: we are looking for Senior Python/Data Engineer. Role: Senior Python/Data Engineer Location: Bangalore/ Pune Experience: 4 to 8 Years Job Type: Full Time Employment What You'll Do: Analysis and implementation of Batch ETL framework using Apache Air Flow, Python, PySpark and Bigquery. Acquire deep domain understanding to implement Data...

  • Data Engineer

    2 months ago

    Pune, Maharashtra, India ADVANSOFT Full time

    Position: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India ADVANSOFT Full time

    Position: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...