Senior Python Azure developer with PySparks

2 days ago

Hyderabad, India ScaleneWorks Full time

Job Title: Senior Node.js and Python Azure developer ( AWS to Azure Migration expert) Experience: 7-10 Yrs. Primary Skills: Python, PySpark - Python API Hands-on experience with Azure, Serverless (Azure Functions) AWS to Azure Cloud Migration (Preferred) Nice to have: Experience in Databricks , ADF mapping dataflow and Synapse Spark Scope of Work: Hand-on experience in migration of Python application from AWS to Azure environment Experience in PySpark - Python API Experience in Databricks , ADF mapping dataflow and Synapse Spark Analyse source architecture, Source code and AWS service dependencies to identify code remediations scenarios. Perform code remediations/Refactoring and configuration changes required to deploy the application on Azure, including Azure service dependencies and other application dependencies remediations at source code. 8+ years of experience in application development with Python Experience in Unit testing, application testing support and troubleshooting on Azure. Experience in application deployment scripts/pipelines, App service, APIM, AKS/Microservices/containerized apps, Kubernetes, helm charts. Hands-on experience in developing apps for AWS and Azure (Must Have) Hands-on experience with Azure services for application development (AKS, Azure Functions) and deployments. Understanding of Azure infrastructure services required for hosting applications on Azure PaaS or Serverless. Tech stack details: Confluent Kafka AWS S3 Sync connector Azure Blob Storage AWS lambda to Azure Functions (Serverless) Python S3 to Azure Blob Storage AWS to Azure SDK Conversion (Must Have) Qualifications Educational qualification: B.E/B.Tech/MCA Experience : 7-10 years Mandatory/requires Skills : Hand-on experience in migration of Node.js and Python application from AWS to Azure environment 8+ years of experience in application development with NPython Experience in PySpark - Python API Experience in Databricks , ADF mapping dataflow and Synapse Spark Experience in Unit testing, application testing support and troubleshooting on Azure. Experience in application deployment scripts/pipelines, App service, APIM, AKS/Microservices/containerized apps, Kubernetes, helm charts. Hands-on experience in developing apps for AWS and Azure (Must Have) Hands-on experience with Azure services for application development (AKS, Azure Functions) and deployments. Understanding of Azure infrastructure services required for hosting applications on Azure PaaS or Serverless. Analyse source architecture, Source code and AWS service dependencies to identify code remediations scenarios. Perform code remediations/Refactoring and configuration changes required to deploy the application on Azure, including Azure service dependencies and other application dependencies remediations at source code. Tech stack details: Confluent Kafka AWS S3 Sync connector Azure Blob Storage AWS lambda to Azure Functions (Serverless) Python S3 to Azure Blob Storage AWS to Azure SDK Conversion (Must Have)

  • Python, Pyspark, ADB, ADF

    4 weeks ago

    Hyderabad, India Fusion Plus Solutions Full time

    Job Description We are seeking an experienced and motivated Senior Data Engineer with strong expertise in Python, PySpark, Azure Databricks, and Azure Data Factory (ADF). The ideal candidate will design and implement scalable data pipelines and play a key role in enabling data-driven decision-making by integrating data across various sources. Key...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, India Digivance Solutions Full time

    Job Title: Data Engineer Location: Hyderabad Experience Required: 7+ years (3+ years relevant in PySpark, Azure Data Factory, Apache HIve and Python)Must have Open Positions: 3 Round of Interviews : 1- Assessment (1:30 hours) 2- Panel (Hyderabad F2F) Valid Passport: Mandate Key Responsibilities Design, develop, and maintain scalable data pipelines using...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, India Digivance Solutions Full time

    Job Title: Data Engineer - Location: Hyderabad - Experience Required: 7+ years (3+ years relevant in PySpark, Azure Data Factory, Apache HIve and Python)Must have - Open Positions: 3 - Round of Interviews: 1- Assessment (1:30 hours) 2- Panel (Hyderabad F2F) - Valid Passport: Mandate Key Responsibilities - Design, develop, and maintain scalable data pipelines...

  • Sr Data Engineer, Azure Databricks, Python, PySpark

    4 weeks ago

    Hyderabad, India Fusion Plus Solutions Full time

    Job Description Job Responsibilities: - Design, develop, and implement robust and scalable data pipelines using Azure Data Factory (ADF). - Efficiently extract, transform, and load (ETL) data from various disparate sources into Azure Data Lake Storage (ADLS). - Utilize Azure Databricks for advanced data processing, transformation, and analytics. - Develop...

  • (3 Days Left) Azure Data Factory, Azure Databricks,Python/Pyspark Professional

    4 weeks ago

    Hyderabad, India Fusion Plus Solutions Full time

    Job Description Skill Set:Azure Data Factory, Azure Databricks, Python/Pyspark - Joining time ( Notice period) Immediate joiners only - AnAzure Data Factory, Azure Databricks, Python/PySpark Professional for Testingplays a vital role in ensuring the accuracy, performance, and reliability of data workflows that involve Azure Data Factory (ADF), Azure...

  • Python pyspark

    2 days ago

    Hyderabad, India Virtusa Full time

    Python pyspark - CREQ Description Design and develop on Hadoop applications. Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALA. Experience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance concepts. Experience on source code management with Git repositories. Secondary skills...

  • Python Developer with Pyspark

    1 week ago

    Hyderabad, Telangana, India Datamaxis Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Python Developer with PysparkHyderabadRole - FulltimeAvailability to Join - ImmediateYears of experience - 5+Required skills and qualifications5+ years of experience as a Python Developer with a strong portfolio of projects.Experience working in Pyspark is mustBachelor's degree in Computer Science, Software Engineering or a related field.In-depth...

  • Pyspark Developer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    TCS is Hiring !!! Job Title: Senior Pyspark Developer Experience: 5 to 7 Years Location: Hyderabad Notice Period: Immediate Joiner- 30 Days Job Description: - Strong proficiency in Python programming. - Hands-on experience with PySpark and Apache Spark. - Knowledge of Big Data technologies (Hadoop, Hive, Kafka, etc.). - Experience with SQL and...

  • Pyspark Developer

    2 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    TCS is Hiring !!! Job Title: Senior Pyspark Developer Experience: 5 to 7 Years Location: Hyderabad Notice Period: Immediate Joiner- 30 Days Job Description: Strong proficiency in Python programming. Hands-on experience with PySpark and Apache Spark. Knowledge of Big Data technologies (Hadoop, Hive, Kafka, etc.). Experience with SQL and...

  • Pyspark Developer

    2 weeks ago

    Hyderabad, India Whatjobs IN C2 Full time

    TCS is Hiring !!! Job Title: Senior Pyspark Developer Experience: 5 to 7 Years Location: Hyderabad Notice Period: Immediate Joiner- 30 Days Job Description: Strong proficiency in Python programming. Hands-on experience with PySpark and Apache Spark. Knowledge of Big Data technologies (Hadoop, Hive, Kafka, etc.). Experience with SQL and...