Senior Data Engineer

2 weeks ago

PuneBangalore, IN ElementSkill Full time

Overview :

We are seeking a highly skilled Senior Data Engineer who possesses extensive experience in data engineering, with a strong emphasis on building, maintaining, and optimizing data pipelines. The ideal candidate will have a deep understanding of data engineering tools and practices, along with the ability to collaborate effectively with cross-functional teams to deliver high-quality data solutions that meet business needs.

Skills :

Data Engineering Tools :

- Strong experience with data engineering tools such as Informatica PowerCenter and Informatica Intelligent Cloud Services (IICS). This includes designing and implementing data integration solutions that ensure data is accessible, accurate, and usable for analytics and reporting.

Programming Proficiency :

- Proficient in programming languages like Python, utilizing its supporting libraries (e.g., Pandas, NumPy) for efficient data processing. Additionally, a strong command of SQL for data manipulation, retrieval, and transformation is essential to manage relational databases effectively.

Cloud Services and Architectures :

- Solid understanding of cloud services and architectures, primarily focusing on AWS. Familiarity with other cloud environments such as Azure and Google Cloud Platform (GCP) is highly desirable. This includes the ability to leverage cloud-native services for data storage, processing, and analytics.

ETL Processes and Data Modeling :

- Expertise in ETL (Extract, Transform, Load) processes, enabling the smooth flow of data from various sources into target systems. Strong skills in data modeling are essential for structuring data effectively to support business intelligence and analytics initiatives.

Workflow Orchestration :

- Familiarity with workflow orchestration tools such as Apache Airflow and AWS Glue. Experience in automating data workflows, scheduling jobs, and ensuring reliable data pipeline operations will be critical for this role.

Experience :

Building and Maintaining Data Pipelines :

- A minimum of 3+ years of experience in building and maintaining data pipelines for diverse data sources and formats using tools like Informatica PowerCenter and IICS. This includes ensuring data integrity and availability across various systems.

Data Quality and Validation :

- Conducted comprehensive data quality checks and implemented robust data validation processes to ensure the accuracy, consistency, and reliability of data across both cloud and on-premise environments. This involves identifying and resolving data discrepancies proactively.

Collaboration with Data Teams :

- Worked collaboratively with data scientists and analysts to provide reliable and timely data for analysis and reporting. This includes understanding their data needs and providing the necessary data infrastructure to support their initiatives.

Setting Up Data Engineering Practices :

- Participated in establishing data engineering practices and standards for various projects and clients, including developing cloud migration strategies to enhance data accessibility and performance. Contributed to best practices in data governance and management.

SQL Query Optimization :

- Designed and optimized complex SQL queries for efficient data retrieval, transformation, and integration with cloud data warehouses like AWS Redshift and Snowflake. This includes tuning queries for performance and ensuring efficient data processing.

Data Monitoring and Alerting :

- Implemented data monitoring and alerting systems to proactively address data pipeline issues and ensure continuous data availability. This involves setting up alerts for data anomalies and performance bottlenecks.

Building Cloud-Native Data Solutions :

- Assisted in building cloud-native data solutions on AWS, focusing on services like S3, Lambda, Redshift, and Athena. Ensured solutions are scalable, high-performing, and cost-effective, adapting to the needs of the organization.

Why Join Us ?

As a Senior Data Engineer, you will have the opportunity to work on cutting-edge data technologies and contribute to transformative projects that enhance our data capabilities. You will play a key role in shaping our data infrastructure, collaborating with talented professionals, and driving data-driven decision-making across the organization. If you are passionate about data engineering and looking for a challenging and rewarding environment, we encourage you to apply.

(ref:hirist.tech)

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Karnataka/Pune/Hyderabad, IN InstaTalent Recruit LLP Full time

    Job Description :As a Senior Data Engineer, you will work to solve some of the most complex and captivating data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team member, and Data Modeling Architect as demanded by each project to define, design, and deliver actionable...

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Chennai/Hyderabad/Pune, IN Capabiliq IT Services Private Limited Full time

    As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team member and Data Modeling lead as demanded by each project to define, design, and deliver actionable insights.On a typical day, you might...

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Hyderabad/Pune/Delhi NCR/Chennai, IN InstaTalent Recruit LLP Full time

    Must Have Skills : Power BI, SQLExperience Level : 7 - 10 YearsJob Title : Senior Data Engineer - Power BI Job Description :Curious about the role? What your typical day would look like?As a Senior Data Engineer, you will work to enhance our business intelligence system to help us make better decisions; Seamlessly switch between roles of an Individual...

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Hyderabad/Chennai, IN InstaTalent Recruit LLP Full time

    Job Description :Job Title : Senior Data Engineer - SynapseLocation : Bengaluru, Chennai, HyderabadExperience : 7 to 10 YearsEmployment Type : Full-timeMust Have Skills : Azure Synapse, Azure, Azure Datalake, ADF, Azure your typical day would look like :As a Senior Data Engineer, you will have the opportunity to solve some of the most captivating data...

  • Senior Data Scientist

    3 weeks ago

    Bangalore/Pune, IN Elite recruitments Full time

    About the Role :We are seeking a highly skilled and experienced Senior Data Science Specialist to join our team. This role requires an individual with 8-10 years of experience in data science, who can leverage their expertise to drive data-driven decision-making and provide actionable insights. The ideal candidate will have a strong background in statistical...

  • Senior Data Engineer

    3 weeks ago

    Chennai/Hyderabad/Bangalore, IN INUMELLAS CONSULTANCY SERVICES PRIVATE LIMITED Full time

    Job Title : Senior Data Engineer - DBTLocation : Chennai , Hyderabad , BangaloreWho we are :Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer :Fullstack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to...

  • Senior Data Engineer

    3 weeks ago

    Pune/Hyderabad, IN BlueByte Technologies Full time

    As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining data integration and reporting solutions. You will utilize SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and advanced SQL to transform raw data into actionable insights.Key Responsibilities :- Data Integration : Design and implement...

  • Senior Data Engineer

    3 weeks ago

    Mumbai/Pune/Gurgaon/Gurugram/Chennai/Bangalore/Hyderabad, IN Symphoni HR Full time

    About the Role :We are seeking a Senior Data Engineer to join our team and contribute to the design, development, and maintenance of our data platform. You will be responsible for building and optimizing data pipelines to support data-driven decision making.Responsibilities :- Design, develop, and maintain data pipelines using Java, Spark, Hive, and Hadoop.-...

  • Publicis Sapient

    3 weeks ago

    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Company Description :Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile...

  • Quantiphi - Senior Data Engineer - Quicksight

    3 weeks ago

    Mumbai/Bangalore/Trivandrum/Thiruvananthapuram, IN Quantiphi Analytics Full time

    Role : Senior Data EngineerExperience Range : 3-7 Years Work Location : Mumbai/ Bangalore/ Trivandrum (Hybrid)Responsibilities :- Design and Implement Data Pipelines : Develop and maintain scalable data pipelines to extract, transform, and load data from various sources into data warehouses or lakes, ensuring high data quality and integrity.- Amazon...

  • Senior Data Engineer

    4 months ago

    Anywhere in India/Multiple Locations/Bangalore, IN Infometry Full time

    Senior Data Engineer Company: Infometry IncLocation: RemoteRole : Senior data EngineerShift : 2PM-11PMEXP: 4-7 yearsNP: ImmediateJob Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data...

  • Senior Data Analytics Architect

    3 weeks ago

    Bangalore/Karnataka/Pune/Maharashtra, IN Tekfortune IT India Pvt Ltd Full time

    Title : Senior Data and Analytics ArchitectExperience : 12 to 20 yearsWork Location : Bangalore, Pune (Onsite)Notice Period : Immediate to 15 Days Max onlyRequired Skills (Mandatory): Skills : IOT hub, IAM, Event hub, Data warehouse & storage, MQTT, AMQP, Modbus, Kafka, Databricks, Airflow, Apache Spark, Data and Analytics architectureJob Summary :We are...

  • Senior Machine Learning Engineer

    2 days ago

    Bangalore/pune, IN MaimsD Technology Full time

    Role : Senior ML EngineerLocation : Bangalore, PuneExperience : 4 - 7 YrsEmployment Type : Full Time, PermanentWorking mode : RegularNotice Period : Immediate - 15 DaysAbout the Role :We are seeking a highly skilled Senior Data Scientist to join our team and contribute to cutting-edge projects. As a key member of our data science team, you will leverage your...

  • Lead Azure Data Engineer

    3 months ago

    Navi Mumbai/Pune/Bangalore, IN Techno Wise Full time

    Job Summary : We are seeking a highly skilled and motivated individual to join our team as a Senior Azure Data Engineer. The ideal candidate will have a strong background in Azure data technologies, a proven track record of ability to design and implement scalable and efficient data solutions.Responsibilities :- Design, develop, and deploy data pipelines and...

  • Senior Data Scientist

    2 weeks ago

    Pune/Bangalore, IN ElementSkill Full time

    Job Overview :We are seeking a highly skilled and experienced Senior Data Scientist who possesses a robust understanding of both traditional machine learning (ML) methodologies and innovative Generative AI techniques. This role is crucial for leveraging data to drive business decisions and enhance operational efficiencies. The ideal candidate will be adept...

  • TVARIT - Data Engineer - ETL

    3 weeks ago

    Remote/Pune, IN TVARIT Full time

    JD of Senior Data Engineer : TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and...

  • Senior Data Engineer

    1 week ago

    Bangalore/Hyderabad/Pune/Chennai/Delhi NCR, IN INUMELLAS CONSULTANCY SERVICES PRIVATE LIMITED Full time

    Job Description :Role : Data Modeling / Senior Data Engineer. Experience : 6 - 15 Years. Location : Hyderabad, Bangalore, Chennai, Pune & Delhi. Notice Period : Immediate to Max 30 Days (Serving NP with #LWD Preferred). Must-Have : Data Modelling, Architecture, Star or Snowflake Schema , ERWIN Tool, Dimensional Modeling , Relational Modeling , Dimensional...

  • Senior Data Integration Engineer

    3 weeks ago

    Bangalore, Pune ,Mumbai,Noida,Chennai,Hyderabad, IN RAPINNO TECH SOLUTIONS PRIVATE LIMITED Full time

    Job Title : Senior Data Integration Engineer (Talend + Azure + Databricks)Location : Bangalore, Pune, Mumbai, Noida, Chennai, HyderabadWorking Hours : 12 PM IST to 9 PM ISTExperience Required : 6 to 8 YearsNotice Period : Immediate to 3 Weeks MaxJob Description :We are seeking a highly skilled Senior Data Integration Engineer with expertise in Talend and...

  • Data Visualization Engineer

    2 days ago

    Bangalore/Pune, IN MaimsD Technology Full time

    Role : Data Visualization EngineerLocation : Bangalore, PuneExperience : 4 - 7 YrsEmployment Type : Full Time, PermanentWorking mode : RegularNotice Period : Immediate - 15 DayAbout the Role :We are seeking a skilled Data Visualization Engineer to join our team and transform raw data into actionable insights. You will play a crucial role in designing,...

  • Capgemini - Senior Data Engineer - Python/PostgreSQL/BigQuery

    3 weeks ago

    Gurgaon/Gurugram/Mumbai/Pune/Hyderabad/Bangalore, IN Capgemini Full time

    Job Description : An experienced senior data pipeline engineer, able to assist in the on-going development and evolution of the existing Client Platform ETL pipeline.Essential Skills : - 6+ years with extensive experience in Python relational SQL databases (ideally PostgreSQL)- Strong experience in developing and maintaining large ETL projects (including...