Senior Data Engineer

3 months ago

Bengaluru, India ElementSkill Full time

Overview :

We are seeking a highly skilled Senior Data Engineer who possesses extensive experience in data engineering, with a strong emphasis on building, maintaining, and optimizing data pipelines. The ideal candidate will have a deep understanding of data engineering tools and practices, along with the ability to collaborate effectively with cross-functional teams to deliver high-quality data solutions that meet business needs.

Skills :

Data Engineering Tools :

- Strong experience with data engineering tools such as Informatica PowerCenter and Informatica Intelligent Cloud Services (IICS). This includes designing and implementing data integration solutions that ensure data is accessible, accurate, and usable for analytics and reporting.

Programming Proficiency :

- Proficient in programming languages like Python, utilizing its supporting libraries (e.g., Pandas, NumPy) for efficient data processing. Additionally, a strong command of SQL for data manipulation, retrieval, and transformation is essential to manage relational databases effectively.

Cloud Services and Architectures :

- Solid understanding of cloud services and architectures, primarily focusing on AWS. Familiarity with other cloud environments such as Azure and Google Cloud Platform (GCP) is highly desirable. This includes the ability to leverage cloud-native services for data storage, processing, and analytics.

ETL Processes and Data Modeling :

- Expertise in ETL (Extract, Transform, Load) processes, enabling the smooth flow of data from various sources into target systems. Strong skills in data modeling are essential for structuring data effectively to support business intelligence and analytics initiatives.

Workflow Orchestration :

- Familiarity with workflow orchestration tools such as Apache Airflow and AWS Glue. Experience in automating data workflows, scheduling jobs, and ensuring reliable data pipeline operations will be critical for this role.

Experience :

Building and Maintaining Data Pipelines :

- A minimum of 3+ years of experience in building and maintaining data pipelines for diverse data sources and formats using tools like Informatica PowerCenter and IICS. This includes ensuring data integrity and availability across various systems.

Data Quality and Validation :

- Conducted comprehensive data quality checks and implemented robust data validation processes to ensure the accuracy, consistency, and reliability of data across both cloud and on-premise environments. This involves identifying and resolving data discrepancies proactively.

Collaboration with Data Teams :

- Worked collaboratively with data scientists and analysts to provide reliable and timely data for analysis and reporting. This includes understanding their data needs and providing the necessary data infrastructure to support their initiatives.

Setting Up Data Engineering Practices :

- Participated in establishing data engineering practices and standards for various projects and clients, including developing cloud migration strategies to enhance data accessibility and performance. Contributed to best practices in data governance and management.

SQL Query Optimization :

- Designed and optimized complex SQL queries for efficient data retrieval, transformation, and integration with cloud data warehouses like AWS Redshift and Snowflake. This includes tuning queries for performance and ensuring efficient data processing.

Data Monitoring and Alerting :

- Implemented data monitoring and alerting systems to proactively address data pipeline issues and ensure continuous data availability. This involves setting up alerts for data anomalies and performance bottlenecks.

Building Cloud-Native Data Solutions :

- Assisted in building cloud-native data solutions on AWS, focusing on services like S3, Lambda, Redshift, and Athena. Ensured solutions are scalable, high-performing, and cost-effective, adapting to the needs of the organization.

Why Join Us ?

As a Senior Data Engineer, you will have the opportunity to work on cutting-edge data technologies and contribute to transformative projects that enhance our data capabilities. You will play a key role in shaping our data infrastructure, collaborating with talented professionals, and driving data-driven decision-making across the organization. If you are passionate about data engineering and looking for a challenging and rewarding environment, we encourage you to apply.

(ref:hirist.tech)

  • Senior Data Engineering Manager

    4 weeks ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    About the RoleWe are seeking a Senior Data Engineering Manager to lead our engineering team in successfully building and deploying cutting-edge analytics products for consumption by various stakeholders.As a key member of our team, you will be responsible for leading the architecture, design, and delivery of enterprise-grade microservices. You will also...

  • Data Engineering Lead with Scalable Platforms

    3 weeks ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Unlock Career Growth as a Data Engineering LeadWe're seeking an exceptional Data Engineering Lead to join our team at Hevo Data. In this role, you'll have the opportunity to own and build scalable platform services that support thousands of customers' data pipelines and ensure load data reliability to cloud warehouses.The Hevo platform core services will...

  • Hevo Data

    2 months ago

    Bengaluru, India HEVO DATA Full time

    This role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...

  • Senior Analytics Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    Job Title:Senior Analytics EngineerAbout the Role:We are seeking a highly skilled Senior Analytics Engineer to join our team at Data Labs - LANDMARK GROUP. As a key member of our engineering team, you will play a crucial role in designing, building, and deploying cutting-edge analytics products for consumption by different stakeholders.The ideal candidate...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-13 Years Location: BangaloreEmployment Type: Full-TimeMust have experience in Capital Market/Investment banking/BFSI domain.ONLY IMMEDIATE JOINERS (0-15 DAYS)Summary:We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience in SQL, Python, Pyspark...

  • Senior data engineer

    1 month ago

    Bengaluru, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-13 Years Location: BangaloreEmployment Type: Full-TimeMust have experience in Capital Market/Investment banking/BFSI domain.ONLY IMMEDIATE JOINERS (0-15 DAYS)Summary:We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience in SQL, Python, Pyspark...

  • Senior Data Solutions Consultant

    4 weeks ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Overview: We're seeking a skilled Senior Data Solutions Consultant to join our Sales team. This role involves working closely with the sales team to understand customers' business and technical needs and demonstrating how Hevo's platform can address their real-time data replication requirements.

  • Senior Data Engineer

    1 month ago

    Bengaluru, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-13 Years Location: BangaloreEmployment Type: Full-TimeMust have experience in Capital Market/Investment banking/BFSI domain.ONLY IMMEDIATE JOINERS (0-15 DAYS)Summary:We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience inSQL, Python, Pyspark...

  • Data Engineering Director

    3 weeks ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Engineering Leadership OpportunityThis is a unique chance to own and build scalable platform services that support thousands of customers' data pipelines, ensuring load data reliability to cloud warehouses.The Hevo platform core services will provide no-code-low pipeline building capabilities, making a significant impact on the company's business.About the...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India Rakuten Symphony Full time

    Job Title: Senior Data EngineerLocation: Bangalore, IndiaCompany: Rakuten Symphony, IndiaOverviewRakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in large-scale...

  • Senior data engineer

    1 month ago

    Bengaluru, India Rakuten Symphony Full time

    Job Title: Senior Data EngineerLocation: Bangalore, IndiaCompany: Rakuten Symphony, IndiaOverviewRakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in large-scale...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India Rakuten Symphony Full time

    Job Title: Senior Data EngineerLocation: Bangalore, IndiaCompany: Rakuten Symphony, IndiaOverviewRakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in large-scale...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India Rakuten Symphony Full time

    Job Title: Senior Data EngineerLocation: Bangalore, IndiaCompany: Rakuten Symphony, IndiaOverviewRakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in large-scale...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in...

  • Senior data engineer

    2 months ago

    Bengaluru, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data EngineerExperience: 8-10 YearsLocation: BangaloreEmployment Type: Full-TimeMust have experience in Capital Markets, Investment banking domain.---Summary:We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Prodcon Tech Services Pvt Ltd Full time

    Job Title: Senior Data EngineerOverview of the Role: We are seeking a highly skilled Senior Data Engineer to join our team at Prodcon Tech Services Pvt Ltd. This individual will be responsible for designing, developing, and maintaining data pipelines and data warehousing solutions.The ideal candidate will have strong expertise in Amazon Data Warehouse (ADB)...

  • Senior Data Engineer

    1 month ago

    Bengaluru, Karnataka, India Kloud9 Full time

    Job Description for Senior Data EngineerCompany OverviewKloud9 is a dynamic and innovative company that requires a skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining our data pipelines and ETL processes.ResponsibilitiesCollaborate with cross-functional teams to...

  • Data Engineer

    2 months ago

    Bengaluru, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineering Leader

    3 days ago

    Bengaluru, Karnataka, India Data Inc Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Architect to lead our team at Data Inc. This is a key role in shaping the future of our data architecture and driving business growth.About the RoleThe successful candidate will be responsible for overseeing the development and implementation of our data architecture strategy, ensuring alignment...

  • Data engineer

    2 months ago

    Bengaluru, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...