Azure Data Engineer

5 months ago

Greater Bengaluru Area, India Tredence Inc. Full time

About Tredence:


Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia. We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data’s full potential.


Primary Roles and Responsibilities:


● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

● Ability to provide solutions that are forward-thinking in data engineering and analytics space

● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

● Triage issues to find gaps in existing pipelines and fix the issues

● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

● Help joiner team members to resolve issues and technical challenges.

● Drive technical discussion with client architect and team members

● Orchestrate the data pipelines in scheduler via Airflow


Skills and Qualifications:


● Bachelor's and/or master’s degree in computer science or equivalent experience.

● Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

● Deep understanding of Star and Snowflake dimensional modelling.

● Strong knowledge of Data Management principles

● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

● Should have hands-on experience in SQL, Python and Spark (PySpark)

● Candidate must have experience in AWS/ Azure stack

● Desirable to have ETL with batch and streaming (Kinesis).

● Experience in building ETL / data warehouse transformation processes

● Experience with Apache Kafka for use with streaming data / event-based data

● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

● Experience working with structured and unstructured data including imaging & geospatial data.

● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot ● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

● Should have experience working in Agile methodology

● Strong verbal and written communication skills.

● Strong analytical and problem-solving skills with a high attention to detail.



Mandatory Skills: Python/ PySpark / Spark with Azure/ AWS Databricks

  • Azure Data Engineer

    2 weeks ago

    Greater Bengaluru Area, India Tata Consultancy Services Full time

    Greetings from TATA Consultancy Services!!We are currently Hiring For AZURE DATA ENGINEERING Job Location: BANGALOREExp 8+Job descriptionStrong design and data solutioning skills 2) PySpark hands-on experience with complex transformations and large dataset handling experience 3) Good command and hands-on experience in Python. Experience working with...

  • Azure Data Engineer

    5 months ago

    Greater Bengaluru Area, India Tredence Inc. Full time

    About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay...

  • Azure Data Engineer

    3 weeks ago

    Greater Chennai Area, India Hexaware Technologies Full time

    Role: Azure Data EngineerExperience : 4.10 years to 9 yearsWork Location: Open (Bangalore/ Pune/ Mumbai/ Dehradun/ Chennai/ Coimbatore)Key Skills and Experience:As an Azure Data Engineer, we are looking for candidates who possess expertise in the following:• Databricks• Data Factory• SQL• Pyspark/SparkRoles and Responsibilities:As a part of our...

  • Azure Data Engineer

    3 weeks ago

    Greater Chennai Area, India Hexaware Technologies Full time

    Role: Azure Data Engineer Experience : 4.10 years to 9 years Work Location: Open (Bangalore/ Pune/ Mumbai/ Dehradun/ Chennai/ Coimbatore) Key Skills and Experience: As an Azure Data Engineer, we are looking for candidates who possess expertise in the following: • Databricks • Data Factory • SQL • Pyspark/Spark Roles and Responsibilities: As a...

  • Senior Azure Data Engineer with Cloud Expertise

    2 weeks ago

    Greater Bengaluru Area, India Tata Consultancy Services Full time

    Job Title: Senior Azure Data Engineer with Cloud ExpertiseWe are seeking an experienced Senior Azure Data Engineer to join our team at Tata Consultancy Services. As a key member of our cloud engineering team, you will play a critical role in designing and implementing data solutions using strong technical skills.Key Responsibilities:Design and implement...

  • Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India Recro Full time

    Must-Have Skills & Qualifications: Bachelorʼs degree in Computer Science, Engineering, or a related field; Masterʼs degree preferred.• 5+ years of experience in data engineering or a related role.• Proficiency in Apache Airflow for workflow scheduling and management.• Strong experience with Hadoop ecosystems, including HDFS, MapReduce, and Hive.•...

  • Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India Recro Full time

    Must-Have Skills & Qualifications:Bachelorʼs degree in Computer Science, Engineering, or a related field; Masterʼs degree preferred.•5+ years of experience in data engineering or a related role.•Proficiency in Apache Airflow for workflow scheduling and management.•Strong experience with Hadoop ecosystems, including HDFS, MapReduce, and...

  • Azure Data Engineer

    3 weeks ago

    Chennai Metropolitan Area, India Hexaware Technologies Full time

    Role: Azure Data EngineerExperience : 4.10 years to 9 yearsWork Location: Open (Bangalore/ Pune/ Mumbai/ Dehradun/ Chennai/ Coimbatore)Key Skills and Experience:As an Azure Data Engineer, we are looking for candidates who possess expertise in the following:• Databricks• Data Factory• SQL• Pyspark/SparkRoles and Responsibilities:As a part of our...

  • Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India S P A Enterprise Full time

    Hi, Job Title: Data Engineer (Permanent) Location: Bangalore and Pune Job Description: Required Skills: data engineers 6+ years’ experience Python proficiency and it's data structures Libraries: NumPy, pandas, beautiful soup, selenium, pdfplumber, Requests etc. SQL programming DevOps AWS S3 and Azure data bricks

  • Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India S P A Enterprise Full time

    Hi, Job Title: Data Engineer (Permanent)Location: Bangalore and PuneJob Description:Required Skills:data engineers 6+ years’ experiencePython proficiency and it's data structures Libraries: NumPy, pandas, beautiful soup, selenium, pdfplumber, Requests etc. SQL programming DevOps AWS S3 and Azure data bricks

  • Azure data engineer

    1 month ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Databricks Data Engineer **Walkin Interview for Azure Databricks Data Engineer in BangaloreWalkin Interview Date: 14th Dec2024(Saturday)Role: Azure Databricks Data EngineerDesired Experience: 5- 10 YearsJob Location: BangaloreJob Description:· Implementation, and operations of OLTP, OLAP, DW technologies such...

  • Azure Data Engineer

    5 hours ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Databricks Data Engineer **Role: Azure Databricks Data EngineerDesired Experience: 5- 10 YearsJob Location: Hyderabad/BengaluruJob Description:- Technical Requirements Gathering and Development of Functional Specifications.- Design, develop, and maintain scalable data pipelines and ETL processes using Azure...

  • Azure Data Engineer

    1 month ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Databricks Data Engineer **Walkin Interview for Azure Databricks Data Engineer in BangaloreWalkin Interview Date: 14th Dec2024(Saturday)Role: Azure Databricks Data EngineerDesired Experience: 5- 10 YearsJob Location: BangaloreJob Description:· Implementation, and operations of OLTP, OLAP, DW technologies such...

  • Azure data engineer

    3 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Databricks Data Engineer **Role: Azure Databricks Data EngineerDesired Experience: 5- 10 YearsJob Location: Hyderabad/BengaluruJob Description:Technical Requirements Gathering and Development of Functional Specifications.Design, develop, and maintain scalable data pipelines and ETL processes using Azure...

  • Azure data engineer

    2 months ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Description**mandatorySNRequired InformationDetails1Role**Azure Data Bricks/Data/Data Factory Enginner2Required Technical Skill Set**Azure Data Bricks/ADF EnginnerDesired Experience Range**8-11 yearsLocation of RequirementBangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**Build and maintain the technology platform for both on...

  • Azure Data Engineer

    3 weeks ago

    Bengaluru, India Webority Technologies Full time

    Job Title: Azure Data EngineerExperience: 4+ YearsLocation: BangaloreEmployment Type: Full-TimeNotice Period - Immediate JoinerJob Description:We are seeking an experienced Azure Data Engineer with 4+ years of expertise in designing and developing data solutions on the Azure platform. The candidate will work on building scalable data pipelines,...

  • Azure data engineer

    3 weeks ago

    Bengaluru, India JRD Systems Full time

    Sr. Data Engineer – AzureJob Summary:Sr Cloud Data Engineer will be a senior level engineer who is able to lead the development effort/team and will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling, SQL knowledge is a must with Python programming background. The Data Engineer...

  • Azure Data Engineer

    3 weeks ago

    Bengaluru, India JRD Systems Full time

    Sr. Data Engineer – AzureJob Summary:Sr Cloud Data Engineer will be a senior level engineer who is able to lead the development effort/team and will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling, SQL knowledge is a must with Python programming background. The Data Engineer...

  • Azure Data Engineer

    1 month ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!! **TCS is Hiring for Azure Databricks Data Engineer ** Walkin Interview for Azure Databricks Data Engineer in Bangalore Walkin Interview Date: 14th Dec2024(Saturday) Role: Azure Databricks Data Engineer Desired Experience: 5- 10 Years Job Location: Bangalore Job Description: · Implementation, and operations of OLTP,...

  • Azure Data Engineer

    1 month ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Databricks Data Engineer **Walkin Interview for Azure Databricks Data Engineer in BangaloreWalkin Interview Date: 14th Dec2024(Saturday)Role: Azure Databricks Data Engineer Desired Experience: 5- 10 YearsJob Location: BangaloreJob Description:· Implementation, and operations of OLTP, OLAP, DW technologies such...