Azure Data Engineer

1 day ago


Bangalore City, India Andor Tech Full time
Role - Azure Data engineer.Mandatory Hands-on skills - Databricks, Azure Data Factory, SQL, Data modelling, Python. CI/CD is good to haveExperience : 6+yrs JD:The Data Engineer is responsible for identifying relevant data to be gathered and implementing a solution to do so, including knowledge of where to get the data, how to extract it in the right format, and how to augment the data to support data science/analysis requirements. Able to build a robust, fault-tolerant data pipeline that cleans, transforms and aggregates un-organised and messy data into databases or data sources. Able to ensure that data flows smoothly from source to destination so that it can be processed.-

Work together with the Solution- and Data Architect to design the next generation big data platform to support the digital marketing platform.-

Design and implement a new big data solution which supports high amounts- and velocity of data, supports future growth, use latest big data technologies/techniques, is cloud supported and in-line with strategies.-

Design and implement modern data pipelines to extract, clean and process data in batch and real-time from different data sources.-

Use the latest development, testing and deployment techniques to quickly deploy new releases to e.G. deploy new data pipelines and add data sources.-

Help establish best practices around data governance, data security- and privacy (GDPR).-

Work together with the solution- and data architect to the define the target data strategy.Drives and applies Agile Framework within his/her operating environment. Will take direct reports, when applicable, through Agile Framework and its respective tools.-

Source Code Control (e.G. Git, Subversion).-

Open-Source Frameworks (Apache Spark, Hadoop etc.)-

Strong design and coding skills (e.G. Python, Scala, JavaScript).-

Experience with reporting/visualization tools (e.G. SAP Lumira/Design Studio, Spotfire, Power BI)-

Comfortable to work with global stakeholders, internally and externally.-

Experience with SAP technologies (SAP ECC/ERP, SAP BW, SAP HANA etc.)-

Experience with SQL-based technologies (e.G. MSSQL, MySQL, PostgreSQL).-

Experience with Restful API developments.-

Experience with data blending technology (e.G. Alteryx)-

Experience with Microsoft or AWS data stack e.G. Microsoft Azure Data Lake, Hadoop (preferably with Spark), Cosmos DB, HDInsight/HBase, MongoDB, Redis, Azure Table/Blob stores etc.Job Experience RequirementsExperiences-

Interpretation of data, highly analytical, troubleshooting and problem-solving skills.-

Experience with data architecture and design techniques (local/abstract).-

Experience with API techniques/developments.-

Experience with data transformation/blending technology (e.G. Alteryx is preferred).-

Experience with working concepts as data pipelining / data wrangling-

Experience with big data platforms;

working with large datasets, large amounts of data in motion and numerous big data technologies.-

Agile Project Delivery techniques (e.G. SCRUM) & experience creating and using a wide range of scrum and agile artefacts and techniques, automated testing, personas, user stories, agile games etc-

Awareness of Agile Framework and its tools such as Visual Studio Team Services (VSTS)
  • Azure Data Engineer

    2 weeks ago


    Bangalore City, India Recro Full time

    Job Title: Azure Data Engineer Location: Remote Experience Required: 3+ Years Job Overview:We seek a skilled Azure Data Engineer with 3+ years of experience, specializing in SQL, Data Modeling, and Azure Data Engineering tools. You will be responsible for building and enhancing data models, managing data pipelines with Azure Data Factory, and working with...


  • Bangalore City, India Fractal Full time

    We are looking for Azure + Bigdata Engineer within our team. Please find the role details below:About the Role: The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps...

  • Azure Data Engineer

    1 week ago


    Bangalore City, India Hexaware Technologies Full time

    Responsibilities:Primary skill : Databricks, ADF, PysparkSecondary skill : Azure, RDBMS, datawarehouseExperience required : 4.5 years 12 yearsAround 4.5 years of IT experience with at least 2+ yrs in ETL/Pipeline Development using tools such as Azure Databricks/Apache Spark and Azure Data Factory with development expertise on batch and real-time data...

  • Azure Data Engineer

    24 hours ago


    Bangalore City, India Andor Tech Full time

    Role - Azure Data engineer.Mandatory Hands-on skills - Databricks, Azure Data Factory, SQL, Data modelling, Python. CI/CD is good to haveExperience : 6+yrs JD:The Data Engineer is responsible for identifying relevant data to be gathered and implementing a solution to do so, including knowledge of where to get the data, how to extract it in the right format,...

  • Azure Data Engineer

    2 weeks ago


    bangalore, India Recro Full time

    Job Title: Azure Data EngineerLocation: RemoteExperience Required: 3+ YearsJob Overview:We seek a skilled Azure Data Engineer with 3+ years of experience, specializing in SQL, Data Modeling, and Azure Data Engineering tools. You will be responsible for building and enhancing data models, managing data pipelines with Azure Data Factory, and working with...


  • Bangalore City, India PeopleLogic Full time

    Role: Azure Data EngineerMode of Hire: C2HLocation: Bangalore/Chennai/Hyderabad/PuneJob Description:Experience in job scheduling using Oozie or Airflow or any other ETL schedulerDesign and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala.Good experience in designing & delivering data...

  • Data Engineer

    3 days ago


    bangalore, India NTT DATA Full time

    Job Description Data Engineer Grade 07 ResponsibilitiesAssure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements using Azure data factory and Azure databricksDevelop and maintain innovative Azure Azure data factory and Azure databricksSolution design using Microsoft...

  • Azure Data Engineer

    2 weeks ago


    Bangalore City, India Brillio Full time

    3 mandatory (primary) skills Vector Databases management (MS SQL, MS Postgres, Azure Cosmos DB)Azure Data Factory with PythonAzure DatabricksExperience required: 7 to 10yrs Notice period immediate (0 15 days)


  • Bangalore City, India Brillio Full time

    3 mandatory (primary) skills Vector Databases management (MS SQL, MS Postgres, Azure Cosmos DB)Azure Data Factory with PythonAzure DatabricksExperience required: 7 to 10yrs Notice period - immediate (0 - 15 days)

  • Azure data engineer

    2 weeks ago


    bangalore, India Mastek Full time

    5+ years of experience in IT service delivery and operations with global onshore and offshore business modes. Offshore Bangalore Location.3+ years of relevant experience in Azure Analytics space.Experience in designing and hands-on development in cloud-based analytics solutions.Robust hands-on experience on Azure Data Factory, Azure Synapse Analytics, Azure...


  • bangalore, India OWOW Full time

    Job Description Key Responsibilities: 1. Design and Development: o Design, develop, and optimize large-scale data processing pipelines using Databricks on Azure. o Implement ETL processes to ingest and transform data from various sources into our data platform. o Develop scalable and efficient data models to support analytics and reporting needs. 2. Azure...

  • Azure Data Engineer

    3 months ago


    Bangalore, India Firstcareercentre Full time

    Key Responsibilities :As an Azure Data Engineer, you will be responsible for designing, implementing, and managing data solutions using Microsoft Azure services. You will work closely with our data science, analytics, and development teams to ensure our data infrastructure is robust, scalable, and efficient.Key Responsibilities :- Design and develop data...


  • Bangalore, India Nexthire Full time

    Role: Azure Data EngineerExp-5+ yearsLocation- Pune/BangaloreJob Summary: We are seeking a highly skilled Azure Databricks Engineer with 5+ years of experience to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics, with hands-on experience in Azure Databricks. This role requires someone...

  • Azure Databricks

    2 weeks ago


    Bangalore City, India NeerInfo Solutions Full time

    Hiring for Fortune IT CompanyRole: Azure Data Engineer/Azure Databricks Experience: 5+ yearsLocation: Bangalore and Hyderabad Experience working as Data Engineer with focus on big data processing and/or relational databases with good understanding of SQLExperienced with working on Structured and Semi-Structured datasets.Experience working with Microsoft...

  • Data Engineer

    2 weeks ago


    Bangalore City, India Quantzig Full time

    We are currently looking for Data Engineer with 1+ years of work experience with good communication and strong technical skills.Role: Data Engineer Experience : 1-3 yearsTechnical Skills :Understand business requirement and actively provide inputs from Data perspectiveUnderstand the underlying data and flow of dataGood knowledge on Azure Data Factory and...

  • Azure Data Engineer

    2 weeks ago


    bangalore, India Andor Tech Full time

    Role - Azure Data engineer.Mandatory Hands-on skills - Databricks, Azure Data Factory, SQL, Data modelling, Python. CI/CD is good to haveExperience : 6+yrsJD:The Data Engineer is responsible for identifying relevant data to be gathered and implementing a solution to do so, including knowledge of where to get the data, how to extract it in the right format,...

  • Data Engineer

    1 day ago


    Bangalore City, India SG Analytics Full time

    ABOUT USSG Analytics, a Great Place to Work (GPTW) certified company, is one of the leading research and analytics firms to offer datacentric research and contextual analytics services to companies across BFSI, Media & Entertainment, Technology & Healthcare sectors including Fortune 500 companies. With a presence in the US, the UK, Switzerland, and India...

  • Azure Data Engineer

    2 weeks ago


    bangalore, India Quantzig Full time

    Company : Quantzig AnalyticsLocation : Kadubeesanahalli, Bangalore.Experience : 3-5 years minimum is requiredNotice : preferably 0 to 30daysJob Description:Seeking a self-driven professional with a strong ownership mentality and the ability to work independently without constant guidance. The ideal candidate will have an agile mindset, capable of swiftly...

  • Senior Data Engineer

    3 months ago


    Bangalore, India Arting Digital Full time

    Job Description : Posting title : Senior Data Engineer Experience : 8+ Years Location : Bangalore Work mode : Hybrid Primary skills : Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Storage, etc.Qualification : Any Engineering/ Computers degreeRoles & Responsibilities :- Design, implement, and manage Azure-based...

  • Azure Data Engineer

    7 days ago


    Bangalore, India Tredence Inc. Full time

    About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay...