Everstream Analytics | Data Engineer

4 days ago

pune, India Everstream Analytics Full time
Job Title: DataEngineer
Location: Pune, India
Department: Data Science
Job Type: Full-Time
Experience Level: 3 years
Reports To: Team Lead
Position Summary:
We are looking for a skilled Data Engineer with strong expertise in Python, AWS data tools, SQL, and large-scale data ingestion methods to join our dynamic team. The ideal candidate should have a solid understanding of data pipelines, a focus on data quality, and familiarity with geospatial data concepts, logistics, and supply chain management. This role will be responsible for designing and building efficient data systems, ensuring data integrity, and supporting business insights by wrangling, analyzing, and documenting complex data sets.
Unable to load the shape
Key Responsibilities:
--> Data Pipeline Development:
Build and maintain scalable and efficient data pipelines using Python and PySpark.
Write SQL queries to extract, transform, and load data from Amazon Athena.
Work on ingestion of large-scale data from various sources using AWS tools (e.g., S3, Redshift, Glue, Lambda, Athena, etc.) with an emphasis on ensuring data quality and integrity.
Implement data quality checks, validation rules, and error-handling mechanisms to ensure accurate data ingestion.
-->Data Exploration and Wrangling:
Utilize NLP techniques and regular expressions to explore, clean, and process unstructured datasets.
Perform data wrangling to structure raw data for further analysis using Pandas or PySpark as appropriate.
Able to apply intermediate SQL techniques for data manipulation and aggregation, optimizing queries for large datasets.
Handle geospatial data and processes related to geolocation, geofencing, and entity deduplication (e.g., address normalization and deduplication of entities such as companies).
-->Exploratory Data Analysis (EDA):
Conduct exploratory data analysis using Python, PySpark, and SQL to discover patterns, trends, and anomalies within large data sets, particularly in the logistics and supply chain management domain.
Leverage knowledge of data from logistics, geolocation, and supply chain to identify key insights and make data-driven recommendations.
-->Data Evaluation & Quality Assurance:
Identify and troubleshoot data quality issues related to geolocation, company addresses, logistics, and supply chain data, ensuring data consistency, accuracy, and reliability.
-->Communication & Documentation:
Reports : Communicate data findings and insights to both technical and non-technical stakeholders through detailed reports.
Task Tracking : Document project progress and tasks using Jira and other project management tools to ensure clear communication and status tracking across teams.
Collaborate with cross-functional teams to ensure alignment on project objectives and deliverables.
Required Qualifications:
Proficiency in Python : Must be highly skilled in Python for data manipulation, ETL (Extract, Transform, Load) processes, and data pipeline development.
SQL Skills : Ability to write and optimize SQL queries for data extraction, transformation, and analysis from large relational databases.
Experience with PySpark : Hands-on experience with PySpark for big data processing is essential.
AWS Data Tools : Solid experience with AWS tools (e.g., S3, Glue, Lambda, Redshift, etc.) for data ingestion, processing, and storage.
NLP and Regular Expressions : Understanding of basic Natural Language Processing (NLP) techniques and hands on experience with regular expressions for data parsing and analysis.
Data Quality Focus : Strong understanding of methods to detect, address, and prevent data quality issues in large-scale datasets.
Preferred Qualifications:
Geospatial Data Knowledge : Familiarity with geolocation, geofencing, and related technologies, along with working experience in handling addresses and deduplication of entities (e.g., company data).
Domain Expertise : Knowledge or experience in logistics and supply chain management will be a significant advantage.
Desired Skills:
Data Wrangling & EDA : Skilled in data wrangling, exploratory data analysis, and identifying actionable insights from complex datasets.
Basic Dashboarding : Ability to create and maintain basic dashboards using tools such as Tableau, Power BI, or similar visualization software to effectively communicate key metrics and data insights.
Documentation & Reporting : Strong skills in documenting analysis, creating detailed reports, and communicating technical concepts to stakeholders.
Collaboration : Ability to work effectively in cross-functional teams and maintain clear communication through Jira and other project management tools.
Why Join Us?
Opportunity to work on cutting-edge projects with large-scale data in the logistics and supply chain industry.
Exposure to advanced data engineering and analytical techniques.
A collaborative work environment with opportunities for growth and development.

  • Everstream Analytics | Product Manager

    4 days ago

    pune, India Everstream Analytics Full time

    We keep the world moving by keeping risk out of the way.Everstream Analytics risk scores and predictive insights set the world’s supply chain standard, helping global companies turn supply chains into business-changing, market-shifting, competition-crushing assets. Removing the traditional blinders of traditional data – we offer more complete...

  • Everstream Analytics | Product Manager

    4 days ago

    pune, India Everstream Analytics Full time

    We keep the world moving by keeping risk out of the way.Everstream Analytics risk scores and predictive insights set the world’s supply chain standard, helping global companies turn supply chains into business-changing, market-shifting, competition-crushing assets. Removing the traditional blinders of traditional data – we offer more complete...

  • Everstream Analytics | Product Manager

    4 days ago

    pune, India Everstream Analytics Full time

    We keep the world moving by keeping risk out of the way.Everstream Analytics risk scores and predictive insights set the world’s supply chain standard, helping global companies turn supply chains into business-changing, market-shifting, competition-crushing assets. Removing the traditional blinders of traditional data – we offer more complete...

  • Everstream Analytics | Product Manager

    6 days ago

    pune, India Everstream Analytics Full time

    We keep the world moving by keeping risk out of the way.Everstream Analytics risk scores and predictive insights set the world’s supply chain standard, helping global companies turn supply chains into business-changing, market-shifting, competition-crushing assets. Removing the traditional blinders of traditional data – we offer more complete...

  • Everstream Analytics | Sales Operations Analyst

    4 days ago

    pune, India Everstream Analytics Full time

    Sales Operations AnalystWe keep the world moving by keeping risk out of the way.Everstream Analytics risk scores and predictive insights set the world’s supply chain standard, helping global companies turn supply chains into business-changing, market-shifting, competition-crushing assets. Removing the traditional blinders of traditional data – we offer...

  • Everstream Analytics | Sales Operations Analyst

    4 days ago

    pune, India Everstream Analytics Full time

    Sales Operations Analyst We keep the world moving by keeping risk out of the way. Everstream Analytics risk scores and predictive insights set the world’s supply chain standard, helping global companies turn supply chains into business-changing, market-shifting, competition-crushing assets. Removing the traditional blinders of traditional data – we...

  • Everstream Analytics | Sales Operations Analyst

    6 days ago

    pune, India Everstream Analytics Full time

    Sales Operations AnalystWe keep the world moving by keeping risk out of the way.Everstream Analytics risk scores and predictive insights set the world’s supply chain standard, helping global companies turn supply chains into business-changing, market-shifting, competition-crushing assets. Removing the traditional blinders of traditional data – we offer...

  • Everstream Analytics | Data Engineer

    4 days ago

    pune, India Everstream Analytics Full time

    Job Title: DataEngineer Location: Pune, India Department: Data Science Job Type: Full-Time Experience Level: 3 years Reports To: Team Lead Position Summary: We are looking for a skilled Data Engineer with strong expertise in Python, AWS data tools, SQL, and large-scale data ingestion methods to join our dynamic team. The ideal candidate should...

  • Everstream Analytics | Data Engineer

    6 days ago

    pune, India Everstream Analytics Full time

    Job Title: DataEngineer Location: Pune, India Department: Data Science Job Type: Full-Time Experience Level: 3 years Reports To: Team Lead Position Summary: We are looking for a skilled Data Engineer with strong expertise in Python, AWS data tools, SQL, and large-scale data ingestion methods to join our dynamic team. The ideal candidate should have a solid...

  • Everstream Analytics | Data Quality Lead

    4 days ago

    pune, India Everstream Analytics Full time

    Job Description -Data Quality LeadEducational Qualifications - Bachelor’s/ Master’s Degree in Engineering.Required Skills:7-8 years of experience in Data Engineering, Data Quality and Data Validation.Hands-on experience in Python and libraries like Pandas, Spark, NumPy.Working experience with relational and NOSQL databases.Understanding of Data...

  • Everstream Analytics | Data Quality Lead

    16 hours ago

    pune, India Everstream Analytics Full time

    Job Description -Data Quality LeadEducational Qualifications - Bachelor’s/ Master’s Degree in Engineering.Required Skills:6-8 years of experience in Data Engineering, Data Quality and Data Validation.Hands-on experience in Python and libraries like Pandas, Spark, NumPy.Working experience with relational and NOSQL databases.Understanding of Data...

  • Everstream Analytics | Data Quality Lead

    5 hours ago

    pune, India Everstream Analytics Full time

    Job Description - Data Quality Lead Educational Qualifications - Bachelor’s/ Master’s Degree in Engineering. Required Skills: 6-8 years of experience in Data Engineering, Data Quality and Data Validation. Hands-on experience in Python and libraries like Pandas, Spark, NumPy. Working experience with relational and NOSQL databases. Understanding of Data...

  • Everstream Analytics | Data Quality Lead

    4 days ago

    pune, India Everstream Analytics Full time

    Job Description - Data Quality Lead Educational Qualifications - Bachelor’s/ Master’s Degree in Engineering. Required Skills: 7-8 years of experience in Data Engineering, Data Quality and Data Validation. Hands-on experience in Python and libraries like Pandas, Spark, NumPy. Working experience with relational and NOSQL databases. Understanding of...

  • Everstream Analytics | Data Quality Lead

    6 days ago

    pune, India Everstream Analytics Full time

    Job Description - Data Quality LeadEducational Qualifications - Bachelor’s/ Master’s Degree in Engineering. Required Skills:7-8 years of experience in Data Engineering, Data Quality and Data Validation.Hands-on experience in Python and libraries like Pandas, Spark, NumPy.Working experience with relational and NOSQL databases.Understanding of Data...

  • Data Quality Strategist

    6 days ago

    Pune, Maharashtra, India Everstream Analytics Full time

    Everstream Analytics seeks a seasoned Data Quality Lead to spearhead the optimization of our data pipelines and ensure the accuracy and reliability of our data.Estimated Salary: $140,000 - $180,000 per yearWe are looking for an expert in data engineering with 7-8 years of experience in Data Quality and Data Validation. The ideal candidate will have hands-on...

  • Data Quality Specialist

    15 hours ago

    Pune, Maharashtra, India Everstream Analytics Full time

    Job SummaryWe are seeking a skilled Data Quality Specialist to join our team at Everstream Analytics. This role will be responsible for ensuring the accuracy and reliability of our data pipelines and transformations.About YouYou will have 6-8 years of experience in Data Engineering, Data Quality, and Data Validation, with hands-on expertise in Python,...

  • Software Quality Assurance Engineer Lead

    3 weeks ago

    Pune, Maharashtra, India Everstream Analytics Full time

    Everstream Analytics is seeking a seasoned Senior Quality Assurance Engineer to lead our QA team.Salary: $120,000 - $180,000 per year.Job DescriptionWe are looking for an experienced Senior Quality Assurance Engineer to join our team at Everstream Analytics. The successful candidate will be responsible for ensuring the highest standards of software quality...

  • Salesforce CRM Specialist

    4 weeks ago

    Pune, Maharashtra, India Everstream Analytics Full time

    About Everstream AnalyticsWe are a forward-thinking analytics company dedicated to delivering cutting-edge solutions. Our mission is to empower businesses with data-driven insights.

  • Lead Software Quality Assurance Specialist

    4 weeks ago

    Pune, Maharashtra, India Everstream Analytics Full time

    Everstream Analytics Career OpportunityWe are seeking an experienced and skilled Sr. QA Engineer to join our Everstream Analytics team.About the Role:The Senior Quality Assurance Engineer will play a key role in ensuring the highest standards of software quality throughout the product development lifecycle.Main Responsibilities:Quality Assurance: Ensure...

  • Product manager

    21 hours ago

    Pune, India Everstream Analytics Full time

    We keep the world moving by keeping risk out of the way. Everstream Analytics risk scores and predictive insights set the world’s supply chain standard, helping global companies turn supply chains into business-changing, market-shifting, competition-crushing assets. Removing the traditional blinders of traditional data – we offer more complete...