Lead - Azure Databricks, Pyspark, SQL

3 weeks ago


delhi, India Infogain Full time
Position: Lead - Azure Databricks
Overall IT experience: 9 to 13 years
Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse
Secondary Skills: U-SQL, Spark, Scala, Python
Work Location: Bengaluru, Pune, Mumbai, Noida, Gurugram
Mode of work: Hybrid at Infogain office locations mentioned above
Notice Period: 0 to 30 Days
Essential experience:
Experience in building ETL / data warehouse transformation processes.
Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).
Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala).
Evaluating the performance and applicability of multiple tools against customer requirements. Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
Coding complex U-SQL, Spark (Scala or Python), T-SQL.
Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks).
  • Databricks Engineer

    2 weeks ago


    Bangalore/Chennai/Delhi NCR/Pune/Kolkata, India Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud. Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company : We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science...


  • Delhi, India Smart Consulting - Creating Future Leaders Full time

    Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes"Location - BangaloreCTC - Upto 24 LPAExperience - 5+ YrsMandatory Skill - Azure, Databricks, PysparkGood to Have - Kubernetes


  • delhi, India Tredence Inc. Full time

    MUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...

  • Data Engineer

    2 months ago


    delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Data Engineer

    1 week ago


    Delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Azure Data Lead

    3 weeks ago


    Delhi, India HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • Data Engineer

    3 weeks ago


    delhi, India The Ksquare Group Full time

    RequirementsBachelor's degree in computer science, information technology, or a related field.Prior experience with data lakes and data warehouses, working knowledge with dimensional modeling is must.Demonstrate advanced understanding in data engineering practices, Including ETL/ELT, data integrations, reusable data pipelines,data management methods.Advanced...


  • Delhi, India Y&L Consulting, Inc. Full time

    HealthCare, Alteryx, Azure Databricks, ADT, .NET core, Python/Pyspark, SSIS, SQLAzure Engineer Requirements: Alteryx, Azure Databricks, ADT, .NET core, Python/Pyspark, SSIS, SQL Healthcare Domain Experience required Position Overview We are seeking a skilled Azure Engineer to join our dynamic team. As the Azure Engineer, you will play a pivotal role in...

  • Manager -Databricks

    1 month ago


    Delhi, India Tredence Full time

    About TredenceTredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities range...


  • Delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...


  • Delhi, India Marlabs LLC Full time

    Description:Job Title: Technical Lead - Azure DatabricksLocation: Bangalore, IndiaPosition Overview:We are looking for an experienced Technical Lead with 8 to 10 years of hands-on experience working on Azure Databricks and Azure native services. The Technical Lead will play a critical role in managing and driving day-to-day data engineering work and leads...

  • Databricks Engineer

    2 weeks ago


    Delhi, India KniTT Full time

    Job Responsibilities:Write pyspark, sql queries on databricksImplement data flows to load dataWrite transformations based on the business logic for a given usecasePerformance optimizationDesigning ETL frameworksSkill set:Essential-Overall Data Engineer ExpSound with Databricks concepts with all the latest features of it (should be the recent one).Proficient...


  • Delhi, India YASH Technologies Full time

    Sr. Software Engineer - AzureExperience: 4 - 7 years of ExperienceWhat you should have?Azure Data Factory, Azure DevOps CI/CD, Azure Data Lake, Azure Synapse, Azure Databricks, PySpark, GitHub.Need 4+ Years of experience Good analytical skills with excellent knowledge of SQL.Well versed with Azure ServicesMust have experience and knowledge on ADF, ADLS, Blob...

  • Lead Consultant

    7 days ago


    Delhi, India Genpact Full time

    Responsibilities• Responsible for development based on client prioritization and approval• Support client technical architects in conducting PoCs , including cost evaluations, of various AWS services and other tools• Develop data ingress frameworks using the AWS tech stack like AWS Glue, Athena, Databricks, Python, Pyspark, SQL• Design and...


  • Delhi, India Bosch Full time

    Job DescriptionOverall 8+ years of experience in IT3+ year experience working on Data Engineering using Databricks,Synapse, ADF.Atleast 4 Project experience in Building and maintaining ETL / ELT pipelines for large data sets , complex data and feature engineering processesMust Have skills : Azure Data factory (ADF), Azure Databricks (ADB), Azure Synapse...


  • Delhi NCR, India VIDPRO CONSULTANCY SERVICES Full time

    About Tredence :Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay...

  • Azure Data Engineer

    6 days ago


    delhi, India Quadrant Technologies Full time

    Title: Azure Data EngineerEducational Qualification: BE/B.Tech/MS/MCA/M.ech or equivalentExperience : 3.5- 7 yearsExcellent communication and problem-solving skillsStrong analytical skills in understanding business requirementsJob Description for an Immediate Requirement:This is a full-time role for a Data Engineer located in Hyderabad with Quadrant...


  • Delhi, India Exusia Full time

    About The PositionDepartment:Sales and Delivery Team - EmpowerIndustry:Information Technology & Services, Computer Software, Management ConsultingLocation:BangaloreExperience Range: 5+ yearsBasic Qualification:Master/Bachelor of Engineering or EquivalentTravel Requirements:Not requiredWebsite:Exusia, a cutting-edge digital transformation consultancy, seeks...


  • delhi, India Impetus Full time

    Hands on experience in deploying Production grade Databricks clusterHands on experience in Shell scripting/Perl/Python/Hive/SQLSound UNIX abilities involving user management, security & permissionsSound knowledge about the Hardware (CPU, memory, disk, network, Firewalls etc.)Sound knowledge about the clustered deployment ArchitectureExposure to cloud...

  • Azure Data Bricks

    2 weeks ago


    delhi, India Capgemini Full time

    "Role: Sr. Cloud Data EngineerSkills: ADF, ADB, Python, PySpark, SqlGood to have Power BI skillT-SQLJob Description:• Will be responsible for the design, development, and administration of data management solutions that align with the business needs of the organization.• Design relational databases to support business enterprise applications and physical...