Architect - Azure Data Engineering

2 months ago


Ibrahim Bagh Lines, India BONbLOC Full time
Job Description:

Cleans, prepares, and optimizes data for further analysis and modelling. Designs, develops, optimizes, and maintains data architecture and pipelines that adhere to Data Pipeline (ie ELT) principles and business goals.

Essential Job Functions / Principal Accountabilities:

Designs, develops, optimizes, and maintains data architecture and pipelines that adhere to ELT principles and business goals. Solves complex data problems to deliver insights that helps business achieve its goals. Creates data products for engineers, analysts, and data scientist team members to accelerate their productivity. Engineer effective features for modelling in close collaboration with data scientists and businesses Leads the evaluation, implementation and deployment of emerging tools and process for analytics data engineering to improve productivity and quality. Partners with machine learning engineers, BI, and solutions architects to develop technical architectures for strategic enterprise projects and initiatives. Fosters a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions. Advises, consults, mentors, and coach other data and analytic professionals on data standards and practices. Develops and delivers communication and education plans on analytic data engineering capabilities, standards, and processes. Learns about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics as necessary to carry out role effectively.

MINIMUM SKILLS AND QUALIFICATION REQUIREMENT: Bachelor’s degree in computer science, statistics, engineering, or a related field 10-15 years of experience required. Experience in PySpark is required for this position, and a strong knowledge of Microsoft Fabric would be a plus. Experience with designing and maintaining data warehouses and/or data lakes with big data technologies such as Spark/Databricks, or distributed databases, like Redshift and Snowflake, and experience with housing, accessing, and transforming data in a variety of relational databases. Experience in building data pipelines and deploying/maintaining them following modern DE best practices (e.G., DBT, Airflow, Spark, Python OSS Data Ecosystem) Knowledge of Software Engineering fundamentals and software development tooling (e.G., Git, CI/CD, JIRA) and familiarity with the Linux operating system and the Bash/Z shell Experience with cloud database technologies (e.G., Azure) and developing solutions on cloud computing services and infrastructure in the data and analytics space. Basic familiarity with BI tools (e.G., Alteryx, Tableau, Power BI, Looker) Expertise in ELT and data analysis, SQL primarily Conceptual knowledge of data and analytics, such as dimensional modelling, reporting tools, data governance, and structured and unstructured data

  • Ibrahim Bagh Lines, India Saxon AI Full time

    Saxon AI is a cutting-edge technology company dedicated to harnessing the power of artificial intelligence and advanced data analytics to drive business transformation. Our mission is to empower organizations to make data-driven decisions by providing innovative solutions that enhance operational efficiency, optimize performance, and unlock new...

  • Data Architect

    3 weeks ago


    Ibrahim Bagh Lines, India BONbLOC Full time

    Job Title: Architect - Azure Data EngineeringClean, prepare, and optimize data for further analysis and modeling. Design, develop, optimize, and maintain data architecture and pipelines that adhere to Data Pipeline (ELT) principles and business goals.Essential Job Functions / Principal Accountabilities:Design, develop, optimize, and maintain data...


  • Ibrahim Bagh Lines, India Accellor Full time

    Accellor - A Leader in Cloud SolutionsWe are proud to be recognized as the "Company of the Year" for "excellence in IT Services" at the Indo Global Business Excellence Awards. Our team, based in Hyderabad, delivers top-notch cloud solutions to clients in the US, UK, and APAC region.About the RoleWe are seeking a highly skilled Data Architect to lead our data...

  • Azure Data Engineer

    3 weeks ago


    Ibrahim Bagh Lines, India Clean Harbors Full time

    Job Title: Azure Data EngineerAt Clean Harbors, we are seeking highly skilled Azure Data Engineers to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure cloud platform.Key Responsibilities:Design data storage systems that scale, perform, and are economical enough...

  • Azure Data Engineer

    3 weeks ago


    Ibrahim Bagh Lines, India Syren Cloud Inc Full time

    Job Title: Lead Azure Data EngineerAt Syren Cloud Inc, we are seeking a highly skilled Lead Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing distributed applications and systems on the Azure Cloud platform.Key Responsibilities:Design and develop data...

  • Azure Data Engineer

    1 month ago


    Ibrahim Bagh Lines, India algoleap Full time

    Job Overview:We are seeking a skilled Data Engineer with expertise in Azure Cosmos DB and SQLto join our team. The ideal candidate will be responsible for designing, developing, and managing data solutions that leverage Cosmos DB to ensure high availability, scalability, and performance. You will work closely with cross-functional teams to integrate and...

  • Azure data engineer

    6 days ago


    Ibrahim Bagh Lines, India Tata Consultancy Services Full time

    Role- Azure Data Engineer Location- Pan India Experience- 5 TO 8 YRSJD-3+ years of relevant experience in Pyspark and Azure Databricks. Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Strong experience in implementing Databricks...

  • Senior Data Architect

    3 weeks ago


    Ibrahim Bagh Lines, India Blackbaud India Full time

    About the RoleWe are seeking a highly skilled Senior Data Architect to join our team at Blackbaud India. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines using Azure Data Factory & Databricks. Your expertise in data modeling, data governance, and data security will be crucial in...


  • Ibrahim Bagh Lines, India Syren Cloud Inc Full time

    Interpret data, analyze results using statistical techniques and provide ongoing reports · Develop and implement databases, data collection systems, data analytics, and other strategies that optimize efficiency and quality · Acquire data from primary or secondary data sources and maintain databases/data systems · Work with business stakeholders, project...

  • Senior Data Engineer

    3 weeks ago


    Ibrahim Bagh Lines, India NewVision Software Full time

    Job SummaryWe are seeking a highly skilled Sr. Data Engineer - Azure to join our team at NewVision Software. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems on Microsoft Azure.Key ResponsibilitiesCollaborate with cross-functional teams to design and implement data...


  • Ibrahim Bagh Lines, India Aptus Data Labs Full time

    Aptus Data Labs Data Platform Lead OpportunityWe are seeking a highly skilled Data Platform Lead to join our team at Aptus Data Labs. As a key member of our data infrastructure team, you will play a pivotal role in designing, implementing, and maintaining robust data platforms that facilitate effective data management, analytics, and governance across the...


  • Ibrahim Bagh Lines, India algoleap Full time

    Job OverviewWe are seeking a skilled Data Engineer with expertise in Azure Cosmos DB and SQL to fill a pivotal role at algoleap. The ideal candidate will be responsible for designing, developing, and managing data solutions that leverage Cosmos DB to ensure high availability, scalability, and performance.Key Responsibilities:Data Management: Design and...

  • Cloud architect

    6 days ago


    Ibrahim Bagh Lines, India Rockwoods Inc Full time

    Job Title: Cloud Architect - Azure Location: Hyderabad Job Type: Contract About the Role: We are seeking a highly skilled and experienced Cloud Architect specializing in Microsoft Azure to join our dynamic team. The ideal candidate will have a strong background in cloud architecture, Infrastructure as Code (Ia C), and Dev Ops practices, with hands-on...

  • Senior Data Architect

    3 weeks ago


    Ibrahim Bagh Lines, India CBRE Full time

    Job Title: Senior Database EngineerAt CBRE, we are seeking a highly skilled Senior Database Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes.Key Responsibilities:Architect and develop data pipelines and ETL processes to ensure...

  • Azure Cloud Architect

    3 weeks ago


    Ibrahim Bagh Lines, India HGS - Hinduja Global Solutions Full time

    Unlock Your Potential as a Cloud Data Engineer at TekLink InternationalWe are seeking a highly skilled and motivated Cloud Data Engineer to join our fast-growing Cloud Analytics practice. As a key member of our team, you will be responsible for designing and implementing scalable, high-performance Azure Analytics solutions for our renowned Fortune 500...


  • Ibrahim Bagh Lines, India EverestDX Inc Full time

    About the CompanyEverestDX is a Digital Platform Services company headquartered in Stamford, with a vision to enable Digital Transformation for enterprises. Our Platform/Solution includes Orchestration, Intelligent operations with BOTs', AI-powered analytics for Enterprise IT.Digital Transformation ServicesWe specialize in Design, Build, Develop, Integrate,...

  • Azure Data Engineer

    1 month ago


    Ibrahim Bagh Lines, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Azure Data EngineerJob Location: Pune / Hyderabad / Chennai Desired Experience Range: 5+ YearsRequired Skill Set: Azure Data Bricks, ADF, Azure SQL, Data Lakes, Pyspark, Key VaultJob Description:· 5+ Years of working experience in Azure ADF· Develop and maintain end-to-end data pipelines using Azure data factory for...

  • Azure Data Engineer

    3 weeks ago


    Ibrahim Bagh Lines, India EverestDX Inc Full time

    About EverestDX IncWe are a Digital Platform Services company, headquartered in Stamford, with a vision to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency, and actionable insights through an integrated set of futuristic digital technologies.Digital Transformation ServicesWe specialize in Design,...

  • Senior Data Architect

    3 weeks ago


    Ibrahim Bagh Lines, India Digile Full time

    Job Title: Senior Data EngineerAt Digile, we're seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using industry-leading tools like Databricks and Azure Data Factory (ADF).Key Responsibilities:Design and...

  • Cloud Architect

    3 weeks ago


    Ibrahim Bagh Lines, India Rockwoods Inc Full time

    Job Title: Cloud Architect - AzureLocation: HyderabadJob Type: ContractAbout the Role:We are seeking a highly skilled and experienced Cloud Architect specializing in Microsoft Azure to join our dynamic team. The ideal candidate will have a strong background in cloud architecture, Infrastructure as Code (IaC), and DevOps practices, with hands-on experience in...