Senior Azure Data Engineer

2 months ago

Bengaluru, India Marktine Technology Solutions Full time

Position : Azure Data Engineer.

Experience : 6+ years.

Location Remote.

Skills: Snowflake, ADF, python and ETL, spark, scala, SQL.

- An offshore Data Engineer to work with the Investment Analytics team.

- This person needs to have a strong exp of Data warehousing and ETL leveraging Snowflake, ADF and Python.

- A strong candidate to work with the Data Science team.

- Collaborate with all the teams to drive discovery and requirements gathering for data management and business analytics efforts.

- Automate ETL for data feeds many sources, and maintain databases.

- Automate data validation of data feeds from many sources, to enhance data accuracy.

- Design and optimize processes for data intake, validation, mining, and engineering.

- Work on a Scrum team to deliver on projects and initiatives that impact business development, client support, business management, investment management, and all functional areas of the firm.

- Designing and developing data pipelines: You will design and implement scalable and efficient data pipelines using Azure Databricks, PySpark, and Scala.

- This includes data ingestion, data transformation, and data loading processes.

- Data modeling and database design: You will design and implement data models to support efficient data storage, retrieval, and analysis.

- This may involve working with relational databases, data lakes, or other storage solutions on the Azure platform.

- Data integration and orchestration: You will leverage Azure Data Factory (ADF) to orchestrate data integration workflows and manage data movement across various data sources and targets.

- This includes scheduling and monitoring data pipelines.

- Data quality and governance: You will implement data quality checks, validation rules, and data governance processes to ensure data accuracy, consistency, and compliance with relevant regulations and standards.

- Performance optimization: You will optimize data pipelines and queries to improve overall system performance and reduce processing time.

- This may involve tuning SQL queries, optimizing data transformation logic, and leveraging caching techniques.

- Monitoring and troubleshooting: You will monitor data pipelines, identify performance bottlenecks, and troubleshoot issues related to data ingestion, processing, and transformation.

- You will work closely with cross-functional teams to resolve data-related problems.

(ref:hirist.tech)

  • Senior Azure Data Engineer

    1 day ago

    Bengaluru, India Spruce InfoTech Inc Full time

    Hope you're doing wellWe are hiring for theSenior Azure Data Engineerrole. Please find the JD belowJOB Designation:Senior Azure Data EngineerJOB Location: Bangalore, IndiaMode of Hiring: Contract (C2H),Notice Period: Immediate to 20 daysExperience: 5-7yearsRequired Skills:5-7 years of experience in Azure cloud platform and data engineering.Proficiency in...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job DescriptionAzure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years’ experience...

  • Senior Azure Data Engineer

    3 weeks ago

    Bengaluru, India Telstra Full time

    Employment Type PermanentClosing Date 18 Sept 2023 11:59pmJob Title Senior Azure Data EngineerJob SummaryAs a Data Management - Senior Specialist, you are the go-to person for developing and implementing effective data management strategies which maximise business and customer outcomes. You play a key role as steward of strong governance, architecture and...

  • Aptus Data Labs

    3 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Job Description Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Azure Sr ConsultantExperience : 10 - 16 YearsLocation : Mumbai/Hyderabad/Bangalore (Onsite)Skill : Azure Cloud, Databricks, Data Quality, Data Governance & Modelling, ETL (Azure data...

  • Senior Azure Data Engineer

    3 weeks ago

    Bengaluru, India Telstra Full time

    Employment TypePermanentClosing Date18 Sept 2023 11:59pmJob TitleSenior Azure Data EngineerJob SummaryAs a Data Management - Senior Specialist, you are the go-to person for developing and implementing effective data management strategies which maximise business and customer outcomes. You play a key role as steward of strong governance, architecture and data...

  • Senior Azure Data Engineer

    2 weeks ago

    Bengaluru, India Telstra Full time

    Employment TypePermanentClosing Date18 Sept 2023 11:59pmJob TitleSenior Azure Data EngineerJob SummaryAs a Data Management - Senior Specialist, you are the go-to person for developing and implementing effective data management strategies which maximise business and customer outcomes. You play a key role as steward of strong governance, architecture and data...

  • Azure Data Engineer/Senior Azure Data Engineer

    2 months ago

    Bengaluru, India Saaki Argus & Averil Consulting Full time

    About the Client:Our client is focused on AI and Analytics.Skills and Qualifications:Bachelors or Masters degree in computer science or equivalent4 to 9 years of total IT experience with 2+ years in big data engineering and Microsoft AzureHands on experience in SQL, python and Spark (pyspark), Big Data.Experience in Azure Databricks, Azure Data...

  • Azure Data Engineer/Senior Azure Data Engineer

    1 week ago

    Bengaluru, India Saaki Argus & Averil Consulting Full time

    About the Client:Our client is focused on AI and Analytics.Skills and Qualifications:Bachelors or Masters degree in computer science or equivalent4 to 9 years of total IT experience with 2+ years in big data engineering and Microsoft AzureHands on experience in SQL, python and Spark (pyspark), Big Data.Experience in Azure Databricks, Azure Data...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...

  • Azure Data Engineer

    4 days ago

    Bengaluru, India Torry Harris Full time

    Are you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level.As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...

  • Senior Azure Big Data Engineer

    1 month ago

    Bengaluru, India Onward Technologies Full time

    Onward Technologies is looking for Senior Azure Big Data EngineerThe RoleYou will be responsible for :Developing scripts to process structured and unstructured data.Recommending, developing and implementing ways to improve data reliability, efficiency and quality.Supporting translation of data business needs into technical system requirements.Working with...

  • Senior Azure Big Data Engineer

    1 week ago

    Bengaluru, India Onward Technologies Full time

    Onward Technologies is looking for Senior Azure Big Data EngineerThe RoleYou will be responsible for :Developing scripts to process structured and unstructured data.Recommending, developing and implementing ways to improve data reliability, efficiency and quality.Supporting translation of data business needs into technical system requirements.Working with...

  • Senior Azure Data Engineer

    2 months ago

    Bengaluru, India Swiss Re Full time

    About the Role:In this role you will work in one of our agile teams, with ingesting data from private and public cloud into Azure Serverless containers, curate the data using Synapse and do advanced analytics and predictions using our strategic Palantir Foundry platform.Key responsibilitiesDesign and implement data pipelines in collaboration with our data...

  • Senior Azure Data Engineer

    1 week ago

    Bengaluru, India Swiss Re Full time

    About the Role:In this role you will work in one of our agile teams, with ingesting data from private and public cloud into Azure Serverless containers, curate the data using Synapse and do advanced analytics and predictions using our strategic Palantir Foundry platform.Key responsibilitiesDesign and implement data pipelines in collaboration with our data...

  • Senior Azure Data Engineer

    2 months ago

    Bengaluru, India Trueblue HR Consultants Full time

    Position: Sr.Azure Data EngineerQualification: Bachelor of Engineer / Computer Science/ MCA / MS Comp Si + Overall 15-20 years experience with 5+ years experience in developing AI solutions.Willing to work with Start up Senior Data Engineers are responsible for delivering high quality modern data solutions through collaboration with our team and our...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Giant Eagle GCC Full time

    Senior Software Engineer - Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, India Arcadis Full time

    ARCADISis looking for Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do. We firmly believe in Everything Digital, Digital Everything. We are transforming, we are reimagining the industry and we are reimagining how communities and nations can help becoming more sustainable places to live for today and future...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, India Arcadis Full time

    ARCADISis looking for Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do. We firmly believe in Everything Digital, Digital Everything. We are transforming, we are reimagining the industry and we are reimagining how communities and nations can help becoming more sustainable places to live for today and future...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Giant Eagle GCC Full time

    Sr Data Engineer Data Analytics Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the Company Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s...