Azure Data Engineer

3 months ago

Greater Bengaluru Area, India Tredence Inc. Full time

About Tredence:


Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia. We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data’s full potential.


Primary Roles and Responsibilities:


● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

● Ability to provide solutions that are forward-thinking in data engineering and analytics space

● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

● Triage issues to find gaps in existing pipelines and fix the issues

● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

● Help joiner team members to resolve issues and technical challenges.

● Drive technical discussion with client architect and team members

● Orchestrate the data pipelines in scheduler via Airflow


Skills and Qualifications:


● Bachelor's and/or master’s degree in computer science or equivalent experience.

● Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

● Deep understanding of Star and Snowflake dimensional modelling.

● Strong knowledge of Data Management principles

● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

● Should have hands-on experience in SQL, Python and Spark (PySpark)

● Candidate must have experience in AWS/ Azure stack

● Desirable to have ETL with batch and streaming (Kinesis).

● Experience in building ETL / data warehouse transformation processes

● Experience with Apache Kafka for use with streaming data / event-based data

● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

● Experience working with structured and unstructured data including imaging & geospatial data.

● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot ● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

● Should have experience working in Agile methodology

● Strong verbal and written communication skills.

● Strong analytical and problem-solving skills with a high attention to detail.



Mandatory Skills: Python/ PySpark / Spark with Azure/ AWS Databricks

  • Azure Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India TEKsystems Full time

    TEKsystems is looking for enthusiasts Azure Data Engineer coming from a hardcore Python background. We are seeking a detail-oriented Azure Data Engineer with strong Python programming skills and working knowledge of PySpark to join our team. You will play a key role in ensuring data integrity and accuracy while utilizing Excel and PowerPoint for report...

  • Azure Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India TEKsystems Full time

    TEKsystems is looking for enthusiasts Azure Data Engineer coming from a hardcore Python background. We are seeking a detail-oriented Azure Data Engineer with strong Python programming skills and working knowledge of PySpark to join our team. You will play a key role in ensuring data integrity and accuracy while utilizing Excel and PowerPoint for report...

  • Azure Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India TEKsystems Full time

    TEKsystems is looking for enthusiasts Azure Data Engineer coming from a hardcore Python background. We are seeking a detail-oriented Azure Data Engineer with strong Python programming skills and working knowledge of PySpark to join our team. You will play a key role in ensuring data integrity and accuracy while utilizing Excel and PowerPoint for report...

  • Azure Data Engineer

    3 months ago

    Greater Bengaluru Area, India Tredence Inc. Full time

    About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay...

  • Azure Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India Quantzig Full time

    Job Title: Azure Data Engineer - Cloud Data ArchitectJob Summary:We are seeking a highly skilled Azure Data Engineer to join our team at Quantzig Analytics. As a key member of our data engineering team, you will be responsible for designing and developing data processing solutions using various ETL tools in the Azure cloud environment.Key...

  • Azure Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India Quantzig Full time

    Company: Quantzig AnalyticsLocation: Kadubeesanahalli, Bangalore.Experience : 6+ years minimum is requiredNotice: preferably 0 to 30daysJob Description:Seeking a self-driven professional with a strong ownership mentality and the ability to work independently without constant guidance. The ideal candidate will have an agile mindset, capable of swiftly...

  • Azure Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India Quantzig Full time

    Company : Quantzig Analytics Location : Kadubeesanahalli, Bangalore. Experience : 6+ years minimum is required Notice : preferably 0 to 30days Job Description: Seeking a self-driven professional with a strong ownership mentality and the ability to work independently without constant guidance. The ideal candidate will have an agile mindset, capable of...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...

  • Lead Azure Engineer

    5 days ago

    Greater Bengaluru Area, India Collabera Digital Full time

    Hi , I’m Amrish from the Talent Team at Ascendion/Collabera Digital. After looking at your profile, I’m sure you’re just the kind of person we’re looking for. I know you’re probably curious to know more about the job and Ascendion, so I’m sharing the job description for one of roles that we hire for and for which you seem to be a good fit. Also...

  • Lead Azure Engineer

    6 days ago

    Greater Bengaluru Area, India Collabera Digital Full time

    Hi ,I’m Amrish from the Talent Team at Ascendion/Collabera Digital. After looking at your profile, I’m sure you’re just the kind of person we’re looking for.I know you’re probably curious to know more about the job and Ascendion, so I’m sharing the job description for one of roles that we hire for and for which you seem to be a good fit. Also let...

  • Azure Data Engineer

    4 weeks ago

    Bangalore Metropolitan Area, India TEKsystems Full time

    TEKsystems is looking for enthusiasts Azure Data Engineer coming from a hardcore Python background. We are seeking a detail-oriented Azure Data Engineer with strong Python programming skills and working knowledge of PySpark to join our team. You will play a key role in ensuring data integrity and accuracy while utilizing Excel and PowerPoint for report...

  • Azure Data Engineer

    3 weeks ago

    Bangalore Metropolitan Area, India TEKsystems Full time

    TEKsystems is looking for enthusiasts Azure Data Engineer coming from a hardcore Python background. We are seeking a detail-oriented Azure Data Engineer with strong Python programming skills and working knowledge of PySpark to join our team. You will play a key role in ensuring data integrity and accuracy while utilizing Excel and PowerPoint for report...

  • Azure data engineer

    2 weeks ago

    Bengaluru, India Recro Full time

    Job Title: Azure Data EngineerLocation: RemoteExperience Required: 3+ YearsJob Overview:We seek a skilled Azure Data Engineer with 3+ years of experience, specializing in SQL, Data Modeling, and Azure Data Engineering tools. You will be responsible for building and enhancing data models, managing data pipelines with Azure Data Factory, and working with...

  • Azure Data Engineer

    5 months ago

    Bengaluru, India Torry Harris Full time

    Are you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level.As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India INES EIT Services India P. Ltd [Formerly Hewlett Packard Global Soft India P] Full time

    Job Title: Azure Data EngineerJob Summary:We are seeking a highly skilled Azure Data Engineer to join our team at INES EIT Services India P. Ltd [Formerly Hewlett Packard Global Soft India P]. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Azure.Key...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Data Engineer - Cloud Solutions Diverse Data Engineering activities on Azure Data platform. Build & Deliver Data pipeline connecting various enterprise data sources. Develop data mappings to existing data sources. Design and develop big data processing notebooks using Azure Databricks. Scripting and programming using programming languages...

  • Data Engineer

    5 months ago

    Bengaluru, India NTT DATA Full time

    Job Description Data Engineer Grade 07ResponsibilitiesAssure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements using Azure data factory and Azure databricksDevelop and maintain innovative Azure Azure data factory and Azure databricksSolution design using Microsoft Azure...

  • Azure Data Engineer

    2 months ago

    Greater Noida, India 5100 Kyndryl Solutions Private Limited Full time

    Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The...

  • Azure Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Recro Full time

    Job Title: Azure Data EngineerLocation: RemoteExperience Required: 3+ YearsJob Overview:We are seeking a skilled Azure Data Engineer with 3+ years of experience in SQL, data modeling, and Azure Data Engineering tools. As a key member of our team, you will be responsible for designing and implementing data models, managing data pipelines with Azure Data...

  • Azure Data Engineer

    2 months ago

    Bengaluru, India Recro Full time

    Job Title:Azure Data EngineerLocation:RemoteExperience Required:3+ YearsJob Overview:We seek a skilled Azure Data Engineer with 3+ years of experience, specializing in SQL, Data Modeling, and Azure Data Engineering tools. You will be responsible for building and enhancing data models, managing data pipelines with Azure Data Factory, and working with Azure...