Senior Data Engineer

6 months ago


Remote, India Nthinsight Full time

Job Description :

We are seeking a skilled and experienced Data Engineer with expertise in Python, data warehousing, ETL (Extract, Transform, Load), and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with cross-functional teams to ensure the effective collection, storage, and retrieval of data for analytics and reporting purposes.

Responsibilities :

1 Work with product managers and data analysts to build data products that power our business.

2 Build and maintain data analytics reports, ETL /ELT pipelines, data lakes, and streaming solutions.

3 Analyze new data sources and work with stakeholders to understand the impact of integrating new data into existing pipelines and models

4 Develop & maintain critical data pipelines, using tools such as Apache Airflow, to ensure highly accurate and reliable business reporting

5 Perform ad-hoc analysis and provide insights to stakeholders within the organization such as Marketing, Growth & Sales teams to drive prioritization.

6 Create data visualizations and analytic reports using various tools such as Tableau

7 Optimize database queries to improve and maintain performance on very large data sets.

8 Work closely with the business and analysis team for the deliverables.

Requirements :

1. 8+ years of relevant experience. Masters or Bachelors degree in CS/ML/AI or equivalent discipline.

2. Expertise with coding with Pyspark, Pandas and visualizations with Tableau.

3. Scheduling/orchestrating pipelines using Databricks and Airflow.

4. Expertise with data querying (Snowflake, SQL, Redshift, Spark) and analyzing billions of rows of data points.

5. Familiarity with SQL, especially within cloud-based data warehouses like Snowflake, Google Big Query, and Amazon Redshift

6. Strong understanding of relational DB such as MySQL/PostgreSQL, document-based storage systems such as MongoDB or CouchDB, key-value stores (Memcached, Redis), Column-oriented stores (HBase, Cassandra), graph-oriented stores; their distinct advantages, disadvantages, and trade-offs.

7. Experience building machine learning, statistical, and analytical model, and tuning parameters.

8. Experience designing experiments and extracting insights.

9. Knowledge of various ETL/ ELT techniques and frameworks

If you are a motivated end to end Data Analyst with a passion for building robust and scalable data solutions, we invite you to apply and contribute to our dynamic and innovative team.

(ref:hirist.tech)
  • Azure Data Architect

    6 months ago


    Remote, India Data PlatformExperts Full time

    Job Description: Azure Data Engineer (Architect Level) We are seeking an experienced and highly skilled Azure Data Engineer at the Architect level to lead the design and implementation of complex data solutions on the Microsoft Azure platform. As an Azure Data Engineer Architect, you will be responsible for providing technical expertise, guiding the...

  • Azure Data Architect

    6 months ago


    Remote, India Data PlatformExperts Full time

    **Job Description: Azure Data Architect** **Key Responsibilities**: - **Design and Implementation**: - Design and implement end-to-end data solutions (data models, pipelines, data lakes, data warehouses) in Azure. - Optimize and maintain existing Azure data structures and integration processes. - Ensure architectural solutions are scalable, maintainable,...


  • Remote, India Quantumbricks Full time

    Job Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have over 10 years of experience in designing, developing, and implementing data solutions on Azure. This role involves working closely with cross-functional teams to build scalable, efficient, and secure data platforms. You...


  • Remote, India Quantumbricks Full time

    Job Summary : We are seeking a highly skilled Senior Data Engineer with over 10 years of experience in designing, developing, and managing robust data pipelines, with specific expertise in Informatica Intelligent Cloud Services (IICS). The ideal candidate will have extensive experience in handling complex ETL/ELT processes, cloud data integration, and data...


  • Remote, India Quantumbricks Full time

    Job Summary. We are seeking a highly skilled and experienced Senior AWS Data Engineer to lead our cloud data architecture, design, and development initiatives. The ideal candidate will have deep expertise in building and managing large-scale data pipelines and solutions on AWS, as well as strong experience in data architecture, ETL, and real-time data...


  • Remote, India CodeKart Full time

    Job Title: Senior Data Pipeline Developer">About CodeKart:">We are a cutting-edge technology firm dedicated to delivering innovative solutions. Our team is passionate about data engineering and committed to excellence.">Job Overview:">We are seeking an experienced Senior Data Pipeline Developer to join our team. As a key member, you will design, develop, and...


  • Remote/Hyderabad, India CAW Studios Pvt Ltd Full time

    Job Title : Senior Data Analytics EngineerReports To : Technical Architect (Data & Analytics)Employment Type : Contract to HireJob Summary :This role requires a skilled data analyst with a strong background in data engineering, analytics development, and administration of data analytics platforms. The candidate will have expertise in Spotfire administration...

  • Azure Data Engineer

    2 weeks ago


    Remote, India Yallo Management Consultancies L.L.C Full time

    Role Type: Contract Location: Remote Duration: 6 months+ Start: ASAP Job Role: As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure...


  • Remote, India Quantumbricks Full time

    Job Summary: We are seeking a highly skilled Senior Data Engineer with over 10 years of experience in designing, developing, and managing robust data pipelines, with specific expertise in Informatica Intelligent Cloud Services (IICS). The ideal candidate will have extensive experience in handling complex ETL/ELT processes, cloud data integration, and data...


  • Remote, India CliqHR Full time

    Job Title: Senior Golang EngineerJob Description: CliqHR is seeking a skilled Senior Golang Engineer to develop and maintain high-quality microservices using Go. Key Responsibilities:Design and implement efficient microservices architecture using Golang.Integrate with various data sources, including APIs, SQL databases, and MongoDB.Collaborate with...


  • Remote, India Beem Line Financial LineFin Technology Solutions Private Limited Full time

    About Beem : Beem is a profitable AI First Fintech Platform that accurately risks ranks over 100M who form the bottom 80% of the US working population, without using FICO. Beem uses this to facilitate payments, and distribution of goods and services, at risk-adjusted prices and at relevant inflection points in their personal financial journey while...

  • Kendryl Expert

    5 months ago


    Remote, India True Data Software Full time

    Kendryl Expert - Description Here Full Time - Remote, Anywhere Vacancy - 12 **About Job**: At True Data Software, we drive innovation and digital transformation for businesses around the globe. Our dedication to excellence and forward-thinking approach ensures our clients receive the most effective solutions. We are looking to expand our team with a...


  • Remote, India ALIQAN Technologies Full time

    Job Title: Senior Data Architect">About the Role:We are seeking an experienced Senior Data Architect to join our team at ALIQAN Technologies. The successful candidate will be responsible for designing, developing, and maintaining our data warehouse infrastructure.">Key Responsibilities:">Database Performance Optimization: Utilize expertise in SQL and...

  • Senior Data Analyst

    1 month ago


    Pune/Remote, India i2e Consulting Pvt Ltd Full time

    Job Title: Senior Data AnalystAs a Senior Data Analyst at i2e Consulting Pvt Ltd, you will play a key role in helping the company achieve its business objectives by leveraging data-driven insights. You will work closely with stakeholders, data scientists, and data engineers to develop and implement data solutions that drive business growth.The ideal...


  • Remote/Pune, India TVARIT Full time

    JD of Senior Data Engineer : TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and...

  • CAW Studios

    1 week ago


    Remote/Hyderabad, India CAW Studios Pvt Ltd Full time

    Job Title : Senior Data Analytics Engineer Reports To : Technical Architect (Data & Analytics), India Employment Type : Contract to Hire Job Summary : This role requires a skilled Data Analytics Engineer with a strong background in data analysis, data engineering, analytics development and administration of data analytics platforms. The candidate will have...

  • Data Engineer

    1 week ago


    Remote, India Cloudcover Consultancy Private Limited Full time

    Job Overview :The Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.The Data Engineer will help build a data and analytics consulting practice by taking part in recruiting efforts,...


  • Remote, India CodeKart Full time

    Role : Data Engineer. Experience :3 yr.Location : Remote. Responsibilities : - Provide ongoing support and monitoring for AWS-based data engineering infrastructure. - Ensure the smooth operation of data pipelines and applications in a production environment. - Develop and maintain data pipelines, ETL processes, and data warehouses using AWS services. ...


  • Remote, India Art Technology and Software India Ltd. Full time

    Job Role : Senior Test Automation Engineer/LeadAbout the Role :We are looking for a highly skilled Senior Test Automation Engineer/Lead to join our team at Art Technology and Software India Ltd. The successful candidate will be responsible for designing, developing, and maintaining automated test scripts to ensure the quality of our software products.Main...


  • Remote, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Senior Big Data Engineer Job Summary:At AEXONIC TECHNOLOGIES PRIVATE LIMITED, we are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies. The ideal candidate will have expertise in Google Cloud Platform (GCP) and BigQuery, and will be responsible for designing, building, and maintaining robust data pipelines...