Databricks - de / Sde

2 days ago

Chennai Tamil Nadu, India Tiger Analytics Full time

Strong in Pyspark, Python, PLSQL, SQL
- Desirable to have ETL with batch and streaming (Kinesis).
- Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using data ingestion and transformation components. The following technology skills are required
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience with Dataflow
- Hands-on experience in using Databricks Hands-on experience with at least one of the leading public cloud data platforms (Amazon Web Services and Google Cloud) Experience with column-oriented database technologies (e.g., Big Query, Redshift, Vertica), NoSQL database technologies (e.g., DynamoDB, BigTable, Cosmos DB, etc.), and traditional database systems (e.g., SQL Server, Oracle, MySQL)
- Experience with big data tools like Delta Lake, Databricks
- Experience with Storage, Unity catalog
- Assemble large, complex data sets that meet functional / non-functional business requirements.

**Job Requirement**
- Strong in Pyspark, Python, PLSQL, SQL
- Desirable to have ETL with batch and streaming (Kinesis).
- Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using data ingestion and transformation components. The following technology skills are required
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience with Dataflow
- Hands-on experience in using Databricks Hands-on experience with at least one of the leading public cloud data platforms (Amazon Web Services and Google Cloud) Experience with column-oriented database technologies (e.g., Big Query, Redshift, Vertica), NoSQL database technologies (e.g., DynamoDB, BigTable, Cosmos DB, etc.), and traditional database systems (e.g., SQL Server, Oracle, MySQL)
- Experience with big data tools like Delta Lake, Databricks
- Experience with Storage, Unity catalog
- Assemble large, complex data sets that meet functional / non-functional business requirements.

  • Azure De

    7 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Proficient in Azure Databricks - Develop and maintain ETL processes using PySpark in the Databricks environment, Design, implement, and manage Unity Catalog tables, ensuring optimal structure for data retrieval and storage Good hands-on experience in Pyspark/Scala coding Proficient in Azure Data Factory - Design, develop and maintain data pipelines using...

  • gcp - de/sde

    5 days ago

    Greater Chennai Area, India Tiger Analytics Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    About The RoleWe are looking for GCP Big Data Engineers to be based out of our Chennai/ Bangalore/ Hyderabad office. This role involves a combination of hands-on contribution, customer engagement, and technical team management.As a GCP Data Engineer, you willDesign and build solutions for near real-time stream processing as well as batch processing on the...

  • Apply Now: Azure Data Engineer

    6 hours ago

    Chennai, India Tata Consultancy Services Full time

    Role - Azure Data Engineer Required Technical Skill Set Azure Data Factory + Azure Databricks. Desired Experience Range - 8 TO 12 years Location of Requirement Mumbai, Bangalore, Hyderabad, Chennai, Gurgaon, Pune. Desired Competencies (Technical/Behavioral Competency) Must-Have Azure Data Factory, Azure Databricks Good-to-Have Python/Pyspark Responsibility...

  • Senior Data Developer

    3 weeks ago

    Chennai, India UPS Full time

    Avant de postuler à un emploi, sélectionnez votre langue de préférence parmi les options disponibles en haut à droite de cette page. Découvrez votre prochaine opportunité au sein d'une organisation qui compte parmi les 500 plus importantes entreprises mondiales. Envisagez des opportunités innovantes, découvrez notre culture enrichissante et...

  • Azure Data Engineer

    3 days ago

    Bengaluru, Chennai, Hyderabad, India Sightspectrum Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Exp Range : 6 to 9 years Location : Chennai/ Bangalore / HyderabadLevel : SDE( Senior Data Engineer)Skill: Azure Data EngineerMust have: Azure Databricks, Pysparks, SQL, Devops(CI/CD), Azure services(ADF, ADLS, Event Hub)Good to have: Data modelling, Gen AI, Agentic AI, Streaming AnalyticsRole & responsibilitiesLeverage Databricks to set up scalable data...

  • Associate Data

    3 weeks ago

    Chennai, India UPS Full time

    Avant de postuler à un emploi, sélectionnez votre langue de préférence parmi les options disponibles en haut à droite de cette page. Découvrez votre prochaine opportunité au sein d'une organisation qui compte parmi les 500 plus importantes entreprises mondiales. Envisagez des opportunités innovantes, découvrez notre culture enrichissante et...

  • aws de

    3 weeks ago

    Chennai, India Virtusa Full time

    P3-C3-TSTS AWS Data Engineer Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK(or Terrafoam.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes. Create and manage applications using Python, Pyspark, SQL, Databricks,...

  • Big Data Lead

    2 weeks ago

    Bengaluru, Chennai, Pune, India Hexaware Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ADB- DE: Primary: Azure, Databricks,ADF, Pyspark/Python Secondary:Datawarehouse, Must Have10+ Years of IT experience in Datawarehouse and ETLHands-on data experience on Cloud Technologies on Azure, ADF, Synapse, Pyspark/PythonAbility to understand Design, Source to target mapping (STTM) and create specifications documentsFlexibility to operate from client...

  • Lead Assistant Manager

    1 week ago

    Chennai, India EXL IT service management Full time

    Job Description Job Description: Data & Analytics Specialist (BI/DE/DS/Ops) Role Overview We are seeking a versatile Data & Analytics Specialist who can work across the full spectrum of data capabilities-ranging from data engineering and pipeline management to business intelligence, advanced analytics, and operational excellence. This role is ideal for...

  • Urgent Opening For Data Engineering

    2 weeks ago

    Chennai, Tamil Nadu, India EXL Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Summary:Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram...