Databricks - de / Sde

5 days ago

Chennai Tamil Nadu, India Tiger Analytics Full time

Strong in Pyspark, Python, PLSQL, SQL
- Desirable to have ETL with batch and streaming (Kinesis).
- Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using data ingestion and transformation components. The following technology skills are required
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience with Dataflow
- Hands-on experience in using Databricks Hands-on experience with at least one of the leading public cloud data platforms (Amazon Web Services and Google Cloud) Experience with column-oriented database technologies (e.g., Big Query, Redshift, Vertica), NoSQL database technologies (e.g., DynamoDB, BigTable, Cosmos DB, etc.), and traditional database systems (e.g., SQL Server, Oracle, MySQL)
- Experience with big data tools like Delta Lake, Databricks
- Experience with Storage, Unity catalog
- Assemble large, complex data sets that meet functional / non-functional business requirements.

**Job Requirement**
- Strong in Pyspark, Python, PLSQL, SQL
- Desirable to have ETL with batch and streaming (Kinesis).
- Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using data ingestion and transformation components. The following technology skills are required
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience with Dataflow
- Hands-on experience in using Databricks Hands-on experience with at least one of the leading public cloud data platforms (Amazon Web Services and Google Cloud) Experience with column-oriented database technologies (e.g., Big Query, Redshift, Vertica), NoSQL database technologies (e.g., DynamoDB, BigTable, Cosmos DB, etc.), and traditional database systems (e.g., SQL Server, Oracle, MySQL)
- Experience with big data tools like Delta Lake, Databricks
- Experience with Storage, Unity catalog
- Assemble large, complex data sets that meet functional / non-functional business requirements.

  • Etl Databricks

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. InsureMO rating engine experience required. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). Develop and maintain robust data pipelines...

  • Azure De

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Proficient in Azure Databricks - Develop and maintain ETL processes using PySpark in the Databricks environment, Design, implement, and manage Unity Catalog tables, ensuring optimal structure for data retrieval and storage Good hands-on experience in Pyspark/Scala coding Proficient in Azure Data Factory - Design, develop and maintain data pipelines using...

  • gcp - de/sde

    1 day ago

    Greater Chennai Area, India Tiger Analytics Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    About The RoleWe are looking for GCP Big Data Engineers to be based out of our Chennai/ Bangalore/ Hyderabad office. This role involves a combination of hands-on contribution, customer engagement, and technical team management.As a GCP Data Engineer, you willDesign and build solutions for near real-time stream processing as well as batch processing on the...

  • Senior Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India UPS Full time US$ 1,04,000 - US$ 1,30,878 per year

    Avant de postuler à un emploi, sélectionnez votre langue de préférence parmi les options disponibles en haut à droite de cette page.Découvrez votre prochaine opportunité au sein d'une organisation qui compte parmi les 500 plus importantes entreprises mondiales. Envisagez des opportunités innovantes, découvrez notre culture enrichissante et...

  • Associate Data

    2 weeks ago

    Chennai, Tamil Nadu, India UPS Full time US$ 90,000 - US$ 1,20,000 per year

    Avant de postuler à un emploi, sélectionnez votre langue de préférence parmi les options disponibles en haut à droite de cette page.Découvrez votre prochaine opportunité au sein d'une organisation qui compte parmi les 500 plus importantes entreprises mondiales. Envisagez des opportunités innovantes, découvrez notre culture enrichissante et...

  • aws de

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    P3-C3-TSTS AWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK(or Terrafoam.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, Pyspark, SQL, Databricks, and...

  • Big Data Lead

    1 week ago

    Bengaluru, Chennai, Pune, India Hexaware Technologies Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    ADB- DE: Primary: Azure, Databricks,ADF, Pyspark/Python Secondary:Datawarehouse, Must Have10+ Years of IT experience in Datawarehouse and ETLHands-on data experience on Cloud Technologies on Azure, ADF, Synapse, Pyspark/PythonAbility to understand Design, Source to target mapping (STTM) and create specifications documentsFlexibility to operate from client...

  • Azure Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Yalantis Technologies Full time US$ 1,00,000 - US$ 1,50,000 per year

    Azure Data Engineer SDE:Location: Bengaluru or Hyderabad (Onsite)Interview: Final round should be F2FSalary: Open(Only apply if you are available for F2F interview final discussion)Experience Range 2-4 YearsPrimary (Must have skills)* - To be2+ years of experience in Azure Databricks with PySpark.2+ years of experience in ADF (Azure Data Factory).2+ years of...