Current jobs related to Azure with Pyspark - Thiruvananthapuram, Kerala - UST Global

  • Azure with Pyspark

    4 months ago

    Thiruvananthapuram, Kerala, India UST Global Full time

    9 - 12 Years- 4 Openings- Thiruvananthapuram**Role description**: **Responsibilities**: **Data Pipeline Development**: - Design, implement, and optimize end-to-end data pipelines on Azure, focusing on scalability and performance. - Develop and maintain ETL workflows for seamless data processing. **Azure Cloud Expertise**: - Utilize Azure services such as...

  • Data Engineer

    3 months ago

    thiruvananthapuram, India BayOne Solutions Full time

    Work from office - 3 days/Week Location: Bangalore/Gurgaon Job Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and dimensional...

  • IBP Analyst

    4 days ago

    Thiruvananthapuram, India Tiger Analytics Full time

    About the role: Role: IBP Consultant Desired Experience: 3 - 8 yrs Location: Bangalore, Chennai & Hyderabad As Supply chain consultant specialized in Planning domain (IBP, S&OP etc.), you will work with some of our leading clients in the latest applications of Supply Chain Analytics, Solutions, Platforms, and advanced ML to solve complex business problems....

Azure with Pyspark

3 months ago

Thiruvananthapuram, Kerala, India UST Global Full time

  • 12 Years 4 Openings Thiruvananthapuram
    Role description:

Responsibilities:

Data Pipeline Development:

  • Design, implement, and optimize endtoend data pipelines on Azure, focusing on scalability and performance.
  • Develop and maintain ETL workflows for seamless data processing.

Azure Cloud Expertise:

  • Utilize Azure services such as Azure Data Factory, Azure SQL Database, and Azure Databricks for effective data engineering.
  • Implement and manage data storage solutions on Azure.

Data Transformation with PySpark:

  • Leverage PySpark for advanced data transformations, ensuring highquality and wellstructured output.
  • Implement data cleansing, enrichment, and validation processes using PySpark.

Performance Optimization:

  • Optimize data pipelines, queries, and PySpark jobs to enhance overall performance and scalability.
  • Identify and address performance bottlenecks within data processing workflows.

Requirements:

  • Proven experience as a Data Engineer, emphasizing expertise in Azure.
  • Proficiency in Azure Data Factory and other relevant Azure services.
  • Expertise in PySpark for data processing and analytics is a must.
  • Experience with data modeling, ETL processes, and data warehousing.

Skills:

Azure, PySpark

About UST:

UST is a global digital transformation solutions provider.

For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation.

Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.