Senior Data Engineer

3 weeks ago

Remote, India Oportun Full time

Job Title : Senior Data Engineer

Job Location(s) : India (Remote)

Work Experience : 5 to 9 Years

Responsibilities :

1. Data Architecture and Design :

- Lead the design and implementation of scalable, efficient, and robust data architectures to meet business needs and analytical requirements.

- Collaborate with stakeholders to understand data requirements, build subject matter expertise, and define optimal data models and structures.

2. Data Pipeline Development and Optimization :

- Design and develop data pipelines, ETL processes, and data integration solutions for ingesting, processing, and transforming large volumes of structured and unstructured data.

- Optimize data pipelines for performance, reliability, and scalability.

3. Database Management and Optimisation :

- Oversee the management and maintenance of databases, data warehouses, and data lakes to ensure high performance, data integrity, and security.

- Implement and manage ETL processes for efficient data loading and retrieval.

4. Data Quality and Governance :

- Establish and enforce data quality standards, validation rules, and data governance practices to ensure data accuracy, consistency, and compliance with regulations.

- Drive initiatives to improve data quality and documentation of data assets.

5. Mentorship and Leadership :

- Provide technical leadership and mentorship to junior team members, assisting in their skill development and growth.

- Lead and participate in code reviews, ensuring best practices and high-quality code.

6. Collaboration and Stakeholder Management :

- Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand their data needs and deliver solutions that meet those needs.

- Communicate effectively with non-technical stakeholders to translate technical concepts into actionable insights and business value.

7. Performance Monitoring and Optimization :

- Implement monitoring systems and practices to track data pipeline performance, identify bottlenecks, and optimize for improved efficiency and scalability.

8. Common Software Engineering Requirements :

- You actively contribute to the end-to-end delivery of complex software applications, ensuring adherence to best practices and high overall quality standards.

- You have a strong understanding of a business or system domain with sufficient knowledge & expertise around the appropriate metrics and trends.

- You collaborate closely with product managers, designers, and fellow engineers to understand business needs and translate them into effective software solutions.

- You provide technical leadership and expertise, guiding the team in making sound architectural decisions and solving challenging technical problems.

- Your solutions anticipate scale, reliability, monitoring, integration, and extensibility.

- You conduct code reviews and provide constructive feedback to ensure code quality, performance, and maintainability.

- You mentor and coach junior engineers, fostering a culture of continuous learning, growth, and technical excellence within the team.

- You play a significant role in the ongoing evolution and refinement of current tools and applications used by the team, and drive adoption of new practices within your team.

- You take ownership of (customer) issues, including initial troubleshooting, identification of root cause and issue escalation or resolution, while maintaining the overall reliability and performance of our systems.

- You set the benchmark for responsiveness and ownership and overall accountability of engineering systems.

- You independently drive and lead multiple features, contribute to (a) large project(s) and lead smaller projects.

- You can orchestrate work that spans multiples engineers within your team and keep all relevant stakeholders informed.

- You support your lead/EM about your work and that of the team, that they need to share with the stakeholders, including escalation of issues

Qualifications :

- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.

- 5+ years of experience in data engineering, with a focus on data architecture, ETL, and database management.

- Proficiency in programming languages like Python/Pyspark and Java /Scala

- Expertise in big data technologies such as Hadoop, Spark, Kafka, etc.

- In-depth knowledge of SQL and experience with various database technologies (e.g., PostgreSQL, MySQL, NoSQL databases).

- Experience and expertise in building complex end-to-end data pipelines.

- Experience with orchestration and designing job schedules using the CICD tools like Jenkins and Airflow.

- Ability to work in an Agile environment (Scrum, Lean, Kanban, etc)

- Ability to mentor junior team members.

- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., AWS Redshift, S3, Azure SQL Data Warehouse).

- Strong leadership, problem-solving, and decision-making skills.

- Excellent communication and collaboration abilities.

(ref:hirist.tech)

  • Senior Data Engineer

    6 hours ago

    Remote, India Hire Alpha Full time

    About the Role:We are seeking a highly skilled and motivated Senior Data Warehousing Engineer to join our team. In this critical role, you will play a key part in designing, developing, and maintaining our data warehouse infrastructure.

  • Senior Data Engineer

    2 weeks ago

    Remote, India Uncap Research Labs Full time

    Senior Data Engineer OUR STORY : The tech space is crowded, but most solutions feel like they're cut from the same cloth-missing the mark on what businesses truly need. Organizations are chasing innovation, but too often, it comes at the expense of flexibility, independence, and real technological depthAt AT DAWN Technologies, we're a niche startup...

  • Senior Engineering Lead

    2 days ago

    Remote, India PROARCH IT SOLUTIONS PRIVATE LIMITED Full time

    **Job Overview**ProArch IT Solutions Private Limited is seeking an experienced Senior Data Engineer to join our team. This is a fantastic opportunity for a talented individual to design, develop, and implement data solutions that drive business growth.**Responsibilities and Expectations:**Develop and maintain scalable data architectures to support business...

  • Senior Data Engineering Specialist

    6 hours ago

    Remote, India Think bridge Software Pvt. Ltd. Full time

    Job Description:We are seeking an experienced Senior Data Engineer to join our team at Think bridge Software Pvt. Ltd. as a Databricks Consultant.In this role, you will leverage your expertise in Databricks and data engineering to design and implement scalable data pipelines, optimize data workflows, and enable advanced analytics capabilities for our...

  • Senior AWS Data Engineer Wanted

    2 days ago

    Remote, India HireXtra Full time

    Job Overview: HireXtra is seeking a seasoned Data Engineer to join our team. As a senior member of our engineering team, you will work closely with our data analysts and scientists to design and implement scalable data architectures using AWS services.Responsibilities: Design and develop data pipelines using AWS Glue. Implement serverless computing solutions...

  • Senior Data Warehousing Engineer

    2 weeks ago

    Remote, India Hire Alpha Full time

    About the Role : We are seeking a highly skilled and motivated Senior Data Warehouse Engineer to join our growing team. In this critical role, you will play a key part in designing, developing, and maintaining our data warehouse infrastructure. You will be responsible for building and optimizing data pipelines, ensuring data quality and integrity, and...

  • Senior Data Validation Engineer

    1 hour ago

    Remote, India Avani Technology Full time

    About the RoleWe are looking for a talented Data Quality Assurance Analyst to join our team at Avani Technology. As a senior member of our data assurance team, you will play a critical role in ensuring the accuracy and integrity of our data.ResponsibilitiesEnsure data quality by performing thorough testing of data-related processes and workflows.Collaborate...

  • Data Engineering Consultant Lead

    6 hours ago

    Remote, India Uncap Research Labs Full time

    Job DescriptionThe Senior Data Engineer Consultant will be responsible for gathering requirements, designing and building modern data platforms to support data-driven decision making. This role will execute technical implementation of data engineering and visualization projects.

  • Senior Data Engineering Expert

    4 days ago

    Pune/Remote, India Hoonar Tekwurks Private Limited Full time

    Company Overview: Hoonar Tekwurks Private Limited is a cutting-edge technology company that leverages data engineering expertise to drive business growth.Job Description: We are seeking an experienced Senior Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and deploying high-quality data pipelines using...

  • Senior Data Engineer

    4 weeks ago

    Remote, India Leewayhertz Full time

    We are seeking a skilled and motivated Data Engineer with a strong background in data integration, ETL processes, and data warehousing. The ideal candidate will have over 5 years of experience in data engineering, with a good understanding of data architecture, pipeline creation, and big data technologies. This role requires a proactive individual who can...

  • Azure Data Architect

    5 days ago

    Remote, India Data PlatformExperts Full time

    Job Description: Azure Data Engineer (Architect Level) We are seeking an experienced and highly skilled Azure Data Engineer at the Architect level to lead the design and implementation of complex data solutions on the Microsoft Azure platform. As an Azure Data Engineer Architect, you will be responsible for providing technical expertise, guiding the...

  • Senior Data Engineering Expert

    7 days ago

    Pune/Remote, India Hoonar Tekwurks Private Limited Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Hoonar Tekwurks Private Limited. As a key member of our engineering team, you will be responsible for designing, building, and deploying high-quality data solutions using Apache NIFI.Key Responsibilities:Design and develop efficient data pipelines using Apache...

  • Data Engineer

    2 weeks ago

    Remote, India Mig Staffing Full time

    We are seeking a dynamic and highly skilled Data Engineer who has extensive experience building enterprise scale data platforms and lead these foundational efforts. This role demands someone who not only possesses a profound understanding of the data engineering landscape but is also at the forefront of their game. The ideal candidate will contribute...

  • Senior Big Data Engineer with Hadoop/Hive/Spark Expertise

    2 days ago

    Remote, India DXC Luxoft Full time

    About the RoleThe Senior Big Data Engineer will be responsible for designing and implementing large-scale data management systems using Hadoop and Spark technologies. This includes ensuring high-quality service output is submitted in a timely manner and effectively communicated.

  • Cloud-Native Data Engineer

    2 days ago

    Remote, India PROARCH IT SOLUTIONS PRIVATE LIMITED Full time

    **Data Engineering Opportunity**We are seeking a highly skilled Senior Data Engineer to join our dynamic team at ProArch IT Solutions Private Limited. As a key member of our team, you will be responsible for designing, developing, and implementing data solutions that drive business outcomes.**Key Accountabilities:**Develop and maintain high-quality data...

  • Senior Machine Learning Engineer

    2 hours ago

    Remote, India gethyr Full time

    About the RoleAs a Senior Machine Learning Engineer at GetHyr, you will be responsible for developing and implementing AI-powered features that enhance customer interactions and optimize their journeys within our platform. You will work closely with product managers, engineers, and business leaders to deliver data-driven features and insights that improve...

  • Data Engineering Expertise Required

    2 days ago

    Remote, India HireXtra Full time

    About the Job: As a Senior AWS Data Engineer at HireXtra, you will design and orchestrate data workflows using AWS Step Functions. You will build end-to-end data pipelines, from conception to implementation, ensuring scalability and efficiency.Key Skills: Hands-on experience with CI/CD tools such as Jenkins, GitLab/Github, Jira, Confluence, and other related...

  • Data Science Engineer

    7 days ago

    Remote/Uttarakhand, India Miratech Full time

    Job Description:We are seeking strong Senior Python engineers to join the data team of a leading financial asset management company. The role involves supporting their applications from a data perspective, ensuring the reliability, efficiency, and scalability of data-driven processes.This is a challenging position for someone who can design and implement...

  • Senior Data Science Expert

    2 days ago

    Remote, India Breezy Talent Full time

    Job Title: Senior Data ScientistWe are seeking a skilled and experienced Senior Data Scientist to join our growing team.The ideal candidate should have a strong foundation in Natural Language Processing (NLP) and a passion for learning and applying cutting-edge technologies in Generative AI for NLP tasks.This role requires advanced data science techniques,...

  • Data Engineer

    2 weeks ago

    Remote, India Techolution Full time

    We are looking for a Google Cloud Data Engineer who will help us build a highly scalable and reliable platform to match our exponential growth. As a Google Cloud Data Engineer, you will be responsible for building a solid back end infrastructure which will enable data delivery in near real-time using next-gen technologies. Title : Google Cloud Data Engineer....