Data Engineer

3 weeks ago


Bangalore, Karnataka, India Programming.com Full time

Job Responsibilities for Data Engineer with GCP :

- We are seeking professionals having experience as Data Engineer with GCP

- Perform analysis and interpretation of large and highly complex datasets. Assemble data sets that meet functional / non-functional business requirements. Provide guidance and mentorship to junior data engineers

- Guiding the team to ensure processes, guidelines, and workflows are conducted.

- Independently performing system diagnostics, stakeholder management, and reporting.

- Build, test, and implement the infrastructure required for optimal extraction, transformation, validation, and loading of data from a wide variety of data sources using SQL.

- Identify, design, and implement internal process improvements including automating manual processes, optimizing data analysis delivery, and re-designing data ingestion processes for greater scalability while ensuring proper governance of data sources and data quality.

- Understand best practices for data management, maintenance, reporting, and security; use that knowledge to implement improvements in data onboarding and data ingestion solutions.

- Perform analysis of existing and new data and processes to measure data quality, value of data, and effectiveness of data ingestion processes.

- Work with data and analytics experts to strive for greater functionality in our data systems.

- Consult with our clients to understand the business requirements so successfully build datasets and implement complex big data solutions.

- Work with internal and external stakeholders on data-related issues, and investigations and support their data infrastructure needs.

- Demonstrate best practices on data handling principles.

- Build analytics tools that utilize the data pipeline to provide actionable insights into customer data supply, operational efficiency, and other key business performance metrics.

- Support the design, creation, and delivery of analytical insights and solutions through data analysis and data management.

- Create data tools for analytics, controls, KPI, metrics, and other reports that assist our stakeholders and leaders in building and optimizing our product into an innovative industry leader.

- Use data mining tools and programming languages to prepare data for analysis and visualization.

- Using advanced data visualization tools and storytelling techniques.

- Provide guidance and mentorship to data analysts on preparing data for downstream products or analytical use by building data pipelines to gather data from multiple sources and systems, integrating, consolidating, transforming, and cleansing data, and structuring data for validation and ingestion

- Provide support to others using technical expertise and domain knowledge

- Make decisions within guidelines and policies with high-level direction from the team lead

- Develop work plans for short-term assignments of moderate to high complexity independently

- Identify areas for process improvements and automation opportunities.

- Design, develop, test, and implement new processes, procedures, or system tools that drive operational effectiveness and efficiencies.

QUALIFICATIONS :

- Overall work experience should be between 6 to 10 years

- Hands on experience on GCP, Apache Beam

- Programming Language - JAVA

- Relational databases (e.g. SQL Server, Oracle, MySQL)

- Source code control management systems (e.g. SVN/Git, Github)

- Agile environments (e.g. Scrum)

- Atlassian tooling (e.g. JIRA, Confluence)

(ref:hirist.tech)
  • Aptus Data Labs

    2 hours ago


    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    2 hours ago


    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Staff Engineer

    1 month ago


    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Kafka Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Senior Data Engineer

    1 month ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Python Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Cyitechsearch Full time

    A Python Data Engineer job description typically includes the following responsibilities, qualifications, and skills:Job Description :Responsibilities :- Develop and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into data lakes, warehouses, or databases.- Design, build, and optimize data models and schemas to...

  • Software Engineer

    2 hours ago


    Bangalore, Karnataka, India Talent Xo Full time

    Experience Requirement :- 6 to 13 years of experience in Software Engineering, with a focus on Data and Big Data technologies.- Proven track record of designing, implementing, and maintaining data engineering solutions with high scalability and reliability.Core Skills :- Experience in Data/Big Data Engineering Technologies :- Proficiency in one or more...

  • Senior Engineer

    1 month ago


    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    Immediately hiring for our client for the role of Senior Engineer Data & Analytics. Total Exp : 8+ years. Location: Anywhere in India. What you'll do:As the senior manager of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment.- Data...

  • Senior Data Engineer

    1 month ago


    Bangalore, Karnataka, India Amicon Hub Full time

    Data Engineer role.Location : BangaloreNeed only Immediate Joiners and candidates from Product based/Start up Companies.Responsibilities :- Analyze and organize raw data - Build data systems and pipelines- Evaluate business needs and objectives- Interpret trends and patterns- Conduct complex data analysis and report on results - Prepare data for prescriptive...

  • Senior Data Engineer

    1 month ago


    Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...

  • Software Engineer

    4 weeks ago


    Bangalore, Karnataka, India TalentXo Full time

    We are looking for a talented and motivated Software Engineer to join our growing Data Engineering & Analytics team. In this role, you will play a pivotal role in developing, maintaining, and improving our reporting products and data pipelines.Responsibilities :- Design and develop high-impact, user-facing features for our reporting products, leveraging your...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Mobile Programming LLC Full time

    Job Description :Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring the smooth operation of our data platforms. The ideal candidate should have a strong...

  • Senior Manager

    2 hours ago


    Bangalore, Karnataka, India Avanti staffing Full time

    Mandatory Experience :- Must have more than 12+ YOE in Software Development, working as an Engineering Manager or aboveMandatory Skills :- Must have good experience in any programming language (eg, Java, Python, Go, NodeJs etc)- Must have Experience in Data / BigData Engineering Technologies. - Any two (e.g.Hadoop, HBase, HDFS, Airflow, Spark, Kafka, AWS,...


  • Bangalore, Karnataka, India Boeing India Pvt Ltd Full time

    Boeing is the world's largest aerospace company and a leading provider of commercial airplanes, defense, space, and security systems, and global services. Building on a legacy of over a century of innovation and leadership, Boeing continues to lead the way in technology and innovation, customer delivery, and investment in its people and future growth of...

  • Azure Data Engineer

    1 month ago


    Bangalore, Karnataka, India Talent Bee Consulting Pvt Ltd Full time

    About the job :Ideal Candidate :- 3+ years in Azure Data Engineering- Very good at ADF (Azure Data Factory)- Hands-on experience in designing and implementing data solutions on AzureOrganization :A global provider of Automation solutions in Assembly, Inspection, and Testing for manufacturing industries. With a mission to enhance the efficiency of the...

  • AI Data Engineer

    1 month ago


    Bangalore, Karnataka, India ApicalGo Consultancy Full time

    Primary Purpose :Building and maintaining the company's data infrastructure on the AWS cloud platform, with a specific focus on supporting AI model training, development, and deployment. This includes designing, developing, and implementing data pipelines, ensuring the secure and efficient flow of data for our AI models.Responsibilities :Data for AI...

  • Senior Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Scaling Theory Full time

    As a Senior Data Engineer, you will partner with Software Engineers, Data Scientists, and Business Intelligence Engineers. You will gain a deep understanding of our services and the data they produce and become our resident expert in how to transform that data into a format that is useful for analytics and business intelligence. You will proactively help to...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Dashhire Full time

    The Data Engineer will be responsible for designing, developing, and maintaining the data infrastructure for a healthcare organization. The ideal candidate will have experience in working with healthcare data, including EHR, HIMS, PACS, and RIS. They will also have experience with SQL, Elasticsearch, and data integration tools such as Talend.Responsibilities...