Databricks with Python

2 weeks ago


Coimbatore Tamil Nadu, India Prognova Partners Pvt Ltd Full time

**Databricks with Pyspark & Python**

**Primary Skills**: Databricks with Pyspark, Python

**Secondary skills**: ADF

**Experience**:6 - 12 yrs
- 6+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.
- 4+ years of work experience with very large data warehousing environment
- 4+ years of work experience in Databricks, Pyspark and Python project development work
- Expertise in Bigdata Eco systems like HDFS and Spark
- Strong hands-on experience on Python or Scala.
- Hands on experience on Azure Data Factory.
- Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.
- Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.
- SQL SERVER development work experience with relational databases and knowledge is a must
- Development of Stored Procedures for transformations in ETL pipeline
- Should have work experience in Agile projects
- Write and maintain documentation of the ETL processes via process flow diagrams.
- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse
- Good experience on customer interaction is required.
- Possesses good interpersonal and communication skills.

**Salary**: ₹500,000.00 - ₹2,500,000.00 per year

**Benefits**:

- Provident Fund

Schedule:

- Day shift

Supplemental pay types:

- Yearly bonus

Ability to Relocate:

- Coimbatore, Tamil Nadu: Relocate before starting work (required)

Work Location: In person

Expected Start Date: 20/03/2024


  • Databricks Architect

    3 weeks ago


    coimbatore, India Wipro Full time

    6-12+ years of experience in architecting large scale data & analytics systems,2+ years of handson experience in complex Databricks implementations,Architect level certification from Databricks,Strong written, verbal communication skills, ability to present to CXOs,Collaboration is key. He / She has to work with different sales, presales and partner teams in...


  • tamil nadu, India LTIMindtree Full time

    Job Title: Specialist-Data EngineeringExperience Range: 5.5 to 10 yearsHiring Locations: Bangalore, Hyderabad, Chennai, Kolkata, Noida, Pune, MumbaiTarget Notice Period: Immediate JoinerKey Skills to Look for: Databricks, Data Lake, Pyspark with Unity catalogDatabricks -Module Lead -Job DescriptionThe individual will be working in Unity Catalog migration...

  • Data Engineer

    2 months ago


    Coimbatore, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Job DescriptionPrimary Skills : Databricks with Pyspark, PythonSecondary skills; ADF- 6+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.- 4+ years of work experience with very large data warehousing environment- 4+ years of work experience in Databricks, Pyspark and Python project...

  • Data Engineer

    3 weeks ago


    Coimbatore, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Job DescriptionPrimary Skills : Databricks with Pyspark, PythonSecondary skills; ADF- 6+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.- 4+ years of work experience with very large data warehousing environment- 4+ years of work experience in Databricks, Pyspark and Python project...


  • Tamil Nadu, India LTIMindtree Full time

    Job Title: Specialist-Data EngineeringExperience Range: 5.5 to 10 years Hiring Locations: Bangalore, Hyderabad, Chennai, Kolkata, Noida, Pune, MumbaiTarget Notice Period: Immediate JoinerKey Skills to Look for:Databricks, Data Lake, Pyspark with Unity catalogDatabricks -Module Lead -Job DescriptionThe individual will be working in Unity Catalog migration for...


  • Tamil Nadu, India LTIMindtree Full time

    Job Title: Specialist-Data EngineeringExperience Range: 5.5 to 10 years Hiring Locations: Bangalore, Hyderabad, Chennai, Kolkata, Noida, Pune, MumbaiTarget Notice Period: Immediate JoinerKey Skills to Look for:Databricks, Data Lake, Pyspark with Unity catalogDatabricks -Module Lead -Job DescriptionThe individual will be working in Unity Catalog migration for...


  • Tamil Nadu, India LTIMindtree Full time

    Job Title: Specialist-Data Engineering Experience Range: 5.5 to 10 years Hiring Locations: Bangalore, Hyderabad, Chennai, Kolkata, Noida, Pune, Mumbai Target Notice Period: Immediate Joiner Key Skills to Look for: Databricks, Data Lake, Pyspark with Unity catalog Databricks -Module Lead -Job Description The individual will be working in Unity Catalog...


  • Chennai, Tamil Nadu, India Tiger Analytics Full time

    Strong in Pyspark, Python, PLSQL, SQL - Desirable to have ETL with batch and streaming (Kinesis). - Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using data ingestion and transformation components. The following technology skills are required - Advanced working SQL knowledge and experience...

  • Data Engineer

    3 weeks ago


    Coimbatore, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Job Description : - Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • Data Engineer

    2 months ago


    Coimbatore, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Job Description :- Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system performance...

  • Data Engineer

    2 months ago


    Coimbatore, Tamil Nadu, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Job Description :- Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system performance...

  • Data Engineer

    2 months ago


    Coimbatore, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Job Description : - Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • Java with Python

    3 days ago


    Chennai District, Tamil Nadu, India Javin Global Full time

    4+ Hands on experience in below skill set Strong knowledge in java python and sql queries prior hands on experience in azure linus vms very good debbuging skills sharp enough to understand new concepts and implement it as poc Optional : Exposure to data enginering environment & tools (NIFI, SNOWFLAKE, DATABRICKS ) SKILLS JAVA PYTHON AZURE LINUX...


  • Coimbatore, India timesjobs Full time

    Hiring For Azure data factory with Python and PysparkAzure data factory with Python and PysparkDesired ProfileSkills: Azure data factory with Python and Pyspark, Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Synopse, Azure SQL DB, Cosmos DB, MSSQL, relational databases like Oracle, PostgreSQL, MySQLNotice Period: 0- 30 daysEducation: BE,...

  • Data Scientist

    3 weeks ago


    Coimbatore, India SA Technologies Inc. Full time

    JD: Data Science, ML/MLOPS, Python (All are must) **Your Profile**: - Bachelor's Degree in a quantitative field, like computer science, mathematics, physics, statistics, or engineering with at least 5+ years of industrial background - Minimum 3+ years working experience in the data analytics domain and have successfully led analytic projects based on agile...

  • Data Scientist

    2 weeks ago


    Coimbatore, India ZF Full time

    **What's Next? Join ZF!**: ZF is a global technology company supplying systems for passenger cars, commercial vehicles and industrial technology, enabling the next generation of mobility. ZF allows vehicles to see, think and act. In the four technology domains of Vehicle Motion Control, Integrated Safety, Automated Driving, and Electric Mobility, ZF offers...


  • Chennai, Tamil Nadu, India Qualitest Full time

    Data Test Engineer 1. Preferable with a computer science degree 2. 5+ years of overall experience with minimum 3 years of relevant experience in ETL and Data and BI Report Testing (mandatory) 3. Good understanding about data quality requirements (mandatory) 4. Experience monitoring data quality by designing and deploying data testing at scale 5....

  • Azure Databricks

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Good knowledge and hands on experience in Azure data bricks. Good knowledge and hands on experience in data pipeline. Good knowledge and hands on experience in Data modelling. Good communication skills are required. Knowledge on SQL for analyzing data. **Primary Skills**: Azure data bricks, data pipeline, bugs in data pipeline, datamodelling, python,...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    **Req ID**: 269802 We are currently seeking a Systems Integration Advisor to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data Engineer, you will be responsible for expanding and optimising data and pipeline architectures, and for optimising data collection and flow across functional teams. Your responsibilities include assisting...

  • ETL -SSIS Developer

    3 weeks ago


    tamil nadu, India Hexaware Technologies Full time

    ETL-SSIS Developer :Experience: 4 to 7 YearsPrimary Skills: Azure Data Factory & SSISCreate the STTM (Source to target) mappings from SSIS packages and T-SQL Procedures.Develop and execute unit test cases to validate the ETL process, data transformations, and data integrity with Azure Data Factory (ADF) and Databricks.Must-Have:--Proven experience as an ETL...