Data Engg Python Pyspark

3 weeks ago

chennai, India Virtusa Full time
Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.
At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files Ability to work independently on specialized assignments within the context of project deliverables Take ownership of providing solutions and tools that iteratively increase engineering efficiencies. Design should help embed standard processes, systems and operational models into the BAU approach for end-to-end execution of Data Pipelines Proven problem solving and analytical abilities including the ability to critically evaluate information gathered from multiple sources, reconcile conflicts, decompose high-level information into details and apply sound business and technical domain knowledge Communicate openly and honestly. Advanced oral, written and visual communication and presentation skills the ability to communicate efficiently at a global level is paramount. Ability to deliver materials of the highest quality to management against tight deadlines. Ability to work effectively under pressure with competing and rapidly changing priorities. Excellent communication skills team player.
Roles and responsibilities of a PySpark developer include:
Developing unit tests for all the Spark transformations and helper methods
Building Spark jobs for data aggregation and transformation
Designing and developing data processing pipelines
Collaborating with team members to determine best practices and client requirements for software.
Developing intuitive software that meets and exceeds the needs of the company. Primary Location Chennai, Tamil Nadu, India Job Type Experienced Primary Skills MongoDB, Kafka, AWS Glue, Python Years of Experience 6 Travel No

  • Data Engg Python Pyspark

    2 months ago

    chennai, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...

  • Data Engg Python Pyspark

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...

  • Python Pyspark Developer

    2 months ago

    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...

  • Python Pyspark Developer

    2 months ago

    chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...

  • Python Pyspark Developer

    1 week ago

    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...

  • Python Pyspark Developer

    3 weeks ago

    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...

  • Python Pyspark Developer

    3 weeks ago

    chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...

  • Data Engineer

    3 weeks ago

    Chennai, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    2 months ago

    Chennai, Tamil Nadu, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    2 months ago

    Chennai, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    3 weeks ago

    Chennai, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    2 months ago

    Chennai, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Hiring For Pyspark Python SQL

    2 days ago

    Chennai, India timesjobs Full time

    Hiring For Pyspark Python SQLPyspark Python SQLDesired ProfileSkills : Pyspark Python SQLNotice Period0- 30 daysEducationFull-time graduateLocationPAN India (Bangalore, Hyderabad, Pune, Chennai, Noida, Kolkata, Gurgaon)Emailcareer@krazymantra.com

  • Hiring For Pyspark Python SQL

    1 day ago

    Chennai, Tamil Nadu, India timesjobs Full time

    Hiring For Pyspark Python SQLPyspark Python SQLDesired ProfileSkills : Pyspark Python SQLNotice Period0- 30 daysEducationFull-time graduateLocationPAN India (Bangalore, Hyderabad, Pune, Chennai, Noida, Kolkata, Gurgaon)Email

  • Big Data Engineer

    3 weeks ago

    Chennai, India Sysvine Technologies Full time

    Experience: 5 - 8 yearsKey Skills: Hadoop, Pyspark, Python, SQL, HiveLocation: ChennaiNotice Period: We prefer candidates who can join immediately or candidates who are on break or candidates who are at end of their notice periodWhat are we looking for?We are looking for experienced Big Data Hadoop Developer expertise with Hadoop, Big Data Ecosystems, Hive,...

  • Data Engineer with Python, Pyspark, AWS, Kubernetes, Databricks

    1 week ago

    Chennai, Tamil Nadu, India SecureKloud Full time

    ResponsibilitiesProven experience as a Data Engineer or similar role, preferably working on data-intensive projects.Strong proficiency in programming languages such as Pyspark, Python, SQLHands-on experience in Databricks

  • Big Data Engineer

    1 month ago

    chennai, India Sysvine Technologies Full time

    Experience: 5 - 8 years Key Skills: Pyspark, Python, SQL, Hive, HBase, AWS, Big Data Location: Chennai Notice Period: We prefer candidates who can join immediately or candidates who are on break or candidates who are at end of their notice period What are we looking for? We are looking for an experienced Python with Pyspark Developer to join our fast-growing...

  • AWS Data Engineer

    3 weeks ago

    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    2 months ago

    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...