Data Engineer- Pyspark Development-Technical Lead-C3

3 weeks ago

india Encora Inc. Full time

Data Engineer II

Important Information

Location: Bangalore

Experience: 10+ years

Job Mode: Full-time 

Work Mode: Hybrid 

Job Summary

As a Data Engineer, you will be a key member of our data engineering team, responsible for designing, developing, and maintaining data pipelines and infrastructure. You will collaborate with cross-functional teams to support data-driven decision-making and contribute to the growth and success of our data-driven initiatives.

Responsibilities and Duties

Design, develop, and maintain scalable and efficient data pipelines Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into robust data solutions Implement data integration processes to ingest, transform, and load data from various sources into data warehouses or data lakes Optimize data pipelines for performance, reliability, and scalability Monitor and troubleshoot data pipelines to ensure data quality and reliability Work with cloud-based data platforms and technologies to support data engineering operation Acquire data from primary and secondary sources and maintain databases/systems Interpret data, analyze results using statistical techniques, and provide ongoing reports Develop and implement databases, data collection systems, data analysis, and other strategies that optimize data quality and statistical efficiency Utilize data to answer key business questions promptly and effectively Own and maintain dashboards, reports, and ad-hoc requests for the organization Collaborate with management to prioritize business needs and insights Serve as the go-to person for any ad-hoc data-related inquiries

Qualifications and Skills

Bachelor's degree or equivalent in computer science, systems engineering, or related fields Experience in data management involving the design, construction, and maintenance of operational and analytical data models Experience with programming languages and environments for data analysis Proactive problem detection and resolution

Role-specific Requirements

Technologies: Pyspark hand-on coding, Databricks, AWS/AZURE/GCP  Skillset competencies: Deep knowledge and strong hands-on experience with Databricks

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. 

 At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.

  • Data Engineer- Pyspark Development-Technical Lead-C3

    5 days ago

    India Encora Inc. Full time

    Data Engineer II Important Information Location: Bangalore Experience: 10+ years Job Mode: Full-time Work Mode: Hybrid Job Summary As a Data Engineer, you will be a key member of our data engineering team, responsible for designing, developing, and maintaining data pipelines and infrastructure. You will collaborate with cross-functional...

  • PySpark Data Engineer

    3 weeks ago

    india Edstem Technologies Full time

    We are seeking a talented and experienced PySpark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment.   Key Responsibilities:Data Pipeline Development: Design, develop, and maintain scalable...

  • Data Engineer with Python

    4 weeks ago

    India Unison Consulting Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platformDevelop and maintain ETL jobs using AWS Glue services to process and transform data at scaleOptimize and troubleshoot AWS Glue jobs for performance and reliabilityUtilize Python and PySpark to efficiently handle large volumes of data...

  • Data Engineer with Python

    4 weeks ago

    india Unison Consulting Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale Optimize and troubleshoot AWS Glue jobs for performance and reliability Utilize Python and PySpark to efficiently handle large volumes of data...

  • Big Data Developer

    2 months ago

    Anywhere in India,Multiple Locations Risk Resources LLP Full time

    Responsibilities :- Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP- Define the technical vision and roadmap for big data architecture within the organization- Architect and implement scalable, high-performance big data pipelines using technologies like MapReduce, Hive, Spark, and BigQuery-...

  • Big Data Developer

    3 weeks ago

    Anywhere in India/Multiple Locations Risk Resources LLP Full time

    Responsibilities :- Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP- Define the technical vision and roadmap for big data architecture within the organization- Architect and implement scalable, high-performance big data pipelines using technologies like MapReduce, Hive, Spark, and BigQuery-...

  • Data Engineer with Python

    2 months ago

    india Unison Consulting Pte Ltd Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale. Optimize and troubleshoot AWS Glue jobs for performance and reliability. Utilize Python and PySpark to efficiently handle large...

  • Senior Data Engineer

    7 days ago

    india Randstad Full time

    Job Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...

  • Senior Data Engineer

    2 months ago

    india Randstad Full time

    Job Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...

  • Azure Data Lead

    3 weeks ago

    Anywhere in India/Multiple Locations Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech Lead Job Description : - Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in...

  • Azure Data Lead

    2 months ago

    Anywhere in India/Multiple Locations Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech Lead Job Description : - Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in...

  • Azure Data Lead

    2 months ago

    Anywhere in India/Multiple Locations, IN Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...

  • Azure Data Lead

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...

  • Azure Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations Live Connections Full time

    Azure Data Engineer - Python/PySpark We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment. Key Responsibilities : - PySpark...

  • Azure Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations Live Connections Full time

    Azure Data Engineer - Python/PySpark We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment. Key Responsibilities : - PySpark...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations ARAHAS TECHNOLOGIES PRIVATE LIMITED Full time

    We are currently hiring a Pyspark Data Engineer with AWS expertise with7 years of experience Job Description : - The candidate should have strong skills in Pyspark coding and have a background in AWS technologies such as Airflow- Experience working with complex SQL queries- Good with PySpark, Databricks, and Airflow- Bachelor's or Master's degree...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN ARAHAS TECHNOLOGIES PRIVATE LIMITED Full time

    We are currently hiring a Pyspark Data Engineer with AWS expertise with7 years of experience Job Description :- The candidate should have strong skills in Pyspark coding and have a background in AWS technologies such as Airflow- Experience working with complex SQL queries- Good with PySpark, Databricks, and Airflow- Bachelor's or Master's degree in...

  • AWS Data Engineer

    2 months ago

    india Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's...

  • PySpark Tech Lead

    2 months ago

    Anywhere in India,Multiple Locations TD Newton & Associates Full time

    Technical Skills :- Extensive experience working on software engineering projects and SDLC- Have worked on various development project as developer and/or lead developer.- Capability to understand and comprehend the solution and create a development framework where all the developers will be contributing.- Should be able to create a Test driven development...

  • PySpark Developer

    5 days ago

    Anywhere in India/Multiple Locations LOGIC PLANET IT SERCICES Full time

    We are hiring for the Position of Pyspark DeveloperExperience - 4 YearsSkills - Pyspark, python , DatabricksProject Role : Application DeveloperProject Role Description : Design, build and configure applications to meet business process and application requirements.Must have skills : PySparkGood to have skills :Python (Programming Language), Databricks...