Data Engineer II

7 days ago

Bareilly, India Talentoj Full time

Role Purpose:

The Data Engineer II will play a crucial role in enhancing the data infrastructure and analytics capabilities. This role is vital for building and maintaining data transformation pipelines, monitoring data distribution shifts, managing dataset versions, and analyzing system performance. Contributions in this position will support the continuous improvement of machine learning models, ensuring they operate with high accuracy and efficiency in various production environments.


Role Value:

As a Data Engineer II, you will be instrumental in advancing data engineering processes and infrastructure. Your expertise in building data pipelines, managing datasets, and analyzing system performance will directly impact the efficiency and reliability of machine learning models. By automating data transformation processes and monitoring data distribution shifts, you will help ensure that models are frequently updated and operate effectively in production.


T-Shaped Engineering Expectation:

Beyond deep expertise in data engineering, you will bring a broad understanding of software development, testing, and data science. As a T-shaped Data Engineer, you will take full ownership of the data infrastructure you build, ensuring it is reliable, thoroughly tested, and capable of supporting machine learning and analytics efforts. Your skills in Python, SQL, and cloud environments will enable you to tackle complex data challenges, provide valuable insights into system behavior, and contribute to delivering top-tier identity verification solutions. Your work will play a critical role in maintaining leadership in the online identity verification, eKYC, and AML solutions market.


Example Responsibilities:

  • Building data transformation pipelines with humans in the loop: Automate and expand a semi-manual datasets generation pipeline, including tagging jobs preparation, scheduling, and post-processing to increase the frequency of ML model updates.
  • Data distribution shift monitoring: Design a system capable of detecting changes in data distribution and unknown data types by monitoring ML models in production.
  • Dataset growth strategy: Leverage your expertise in business data and monitoring tools to help identify valuable zones of expansion for automated solutions.
  • Dataset versioning management: Manage and document dataset versions in an ecosystem of highly dependent and evolving datasets.
  • Data volatility management: Develop solutions to stabilize datasets in environments where data retention is time-limited.
  • System performance analysis: Dive into data and models to analyze system behavior on specific transactions and data buckets, producing targeted performance metrics using advanced Python skills.


Experience and Qualifications:

  • Experience building data pipelines in dynamic and evolving environments.
  • Proficiency in Python (pandas, numpy) and SQL for data wrangling.
  • Skilled in data analysis and deep dives using Jupyter notebooks or other notebook tools.
  • Interest or experience in Machine Learning and Data Science.
  • Proficient in leveraging cloud environments.


Great-to-Have Experience and Qualifications:

  • Familiarity with privacy by design.
  • Knowledge of serverless data engineering.
  • Experience with Java, Apache Spark, or Flink.


Work Environment:

Located in a hub of technical excellence with a strong focus on Machine Learning enablement, the team is committed to high standards, innovation, and continuous learning.


Values:

  • IDEAL: Integrity, Diversity, Empowerment, Accountability, Leading Innovation


Equal Opportunities:

We foster a collaborative environment of diverse perspectives and backgrounds, welcoming applications and colleagues from all walks of life.


About Us:

We are a B2B technology company dedicated to eradicating online identity fraud, money laundering, and other financial crimes, working to make the internet a safer space. Through AI, biometrics, machine learning, liveness detection, and automation, we create solutions trusted by global brands across Financial Services, Travel, Sharing Economy, Fintech, Gaming, and other industries.

  • Data Engineer II

    1 month ago

    Bareilly, India tsworks Full time

    Who We Aretsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions and thought leadership to empower businesses to thrive in a digital world. We value our employees, take pride in providing best value in customer...

  • Data Engineer

    7 days ago

    Bareilly, India Huptech HR Solutions Full time

    Job Post :- Data EngineerLocation :- RemoteExperience :- 5+ yearsJob Timing :- 7-8 PM IST to 3-4 AM ISTResponsibilities:Design, develop, and maintain scalable and efficient data pipelines using industry-standard tools and technologies.Implement and optimize ETL processes to ensure data quality, reliability, and performance.Design and maintain SQL Server...

  • Data Engineer

    3 weeks ago

    Bareilly, Uttar Pradesh, India Nielsen Full time

    Job Title: Data Engineer - Big Data SpecialistAt Nielsen, we're seeking a highly skilled Data Engineer to join our team of experts in big data processing. As a Data Engineer - Big Data Specialist, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines...

  • Azure Data Engineer Position

    3 weeks ago

    Bareilly, Uttar Pradesh, India Delphic (South Asia) Full time

    Job SummaryWe are seeking an experienced Azure Data Engineer to join our team at Delphic (South Asia). The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and architectures using Microsoft Azure's cloud platform.Key ResponsibilitiesData Solution Design and ImplementationDevelop, optimize, and...

  • Data Engineer

    5 days ago

    Bareilly, India SourceBae Full time

    Job Title: Data Engineer - Unity CatalogLocation: RemoteExperience: 7+ yearsJob Description:We are urgently looking for an experienced Data Engineer to join our team. This is a remote role with a competitive compensation package. If you have a passion for data engineering and have hands-on experience with Unity Catalog and the latest data technologies, we...

  • Data Engineer

    16 hours ago

    Bareilly, India Charter Global Full time

    Location: HyderabadExperience : 3-6 YrsMode of Work : Hybrid ModelJob Description:•Good hands on building data pipelines on Data tech stack with knowledge on Spark with programming using Python.•Strong expertise on SQL with 3-5 years working on multiple database systems like Postgres, Oracle and Redshift having hands-on experience in implementing data...

  • Senior Data Science

    1 month ago

    Bareilly, India Visa Full time

    Job Description. What a Data Science – Sr. Data Scientist does at Visa:The Data Science – Sr. Data Scientist will be a member of VCA Data Science team in Asia Pacific. The position will be based in Visa’s Bangalore office.The individual will be accountable for supporting and driving the design, development, and implementation of analytics-driven...

  • Data Center Operations Manager

    3 weeks ago

    Bareilly, Uttar Pradesh, India OCS India Full time

    Job Title: Data Center EngineerAre you a seasoned engineer looking for a new challenge? Do you have a passion for maintaining and improving data center operations? We are seeking a highly skilled Data Center Engineer to join our team at OCS India.Key Responsibilities:Ensure the smooth operation of MEP equipment on a day-to-day basis.Track and monitor PPM...

  • Data Analytics Manager

    4 weeks ago

    Bareilly, India NeenOpal Inc. Full time

    NeenOpal is looking for exceptional talent to join our rapidly growing global team. People are our biggest perk! Our transparent and collaborative culture offers a chance to work with some of the brightest minds in the industry. If you are someone who thrives on ambiguity, is a problem solver and yet deliver value to clients, please apply for the...

  • Associate Data Scientist

    3 weeks ago

    Bareilly, India Rapido Full time

    About Rapido We are India’s largest bike-taxi platform, steadily venturing into Delivery, Cabs, Auto, Rental and more. Currently present in over 100 cities, we are growing close to 500% year-on-year with steady funding. We have changed the concept of intra-city travel and made last-mile connectivity affordable to all. Along with being the #1 choice of 10...

  • Data Scientist- NLP

    1 month ago

    Bareilly, India Publicis Re:Sources Full time

    Minimum Experience (relevant): 5Maximum Experience (relevant): 9Locations- Bengaluru, Pune and GurgaonMust have skills:Strong experience working with data science/ML libraries in python (SciPy, NumPy, TensorFlow, SciKit-Learn, etc.)Strong experience working in cloud development environments (especially Azure, ADF, PySpark, Scala, DataBricks Delta, R, SQL...

  • Data Scientist- NLP

    1 month ago

    Bareilly, India Publicis Re:Sources Full time

    Minimum Experience (relevant): 5Maximum Experience (relevant): 9Locations- Bengaluru, Pune and GurgaonMust have skills:Strong experience working with data science/ML libraries in python (SciPy, NumPy, TensorFlow, SciKit-Learn, etc.)Strong experience working in cloud development environments (especially Azure, ADF, PySpark, Scala, DataBricks Delta, R, SQL...

  • Azure Databricks Engineer

    5 days ago

    Bareilly, India Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...

  • Senior Azure Data Technical Lead

    2 weeks ago

    Bareilly, India SourceBae Full time

    Job Title: Senior Azure Data Technical LeadLocation: RemoteExperience: 9 - 11 yearsWe are seeking an experienced Senior Azure Data Technical Lead to join our dynamic team. The ideal candidate will have a robust background in Azure data technologies and proven experience in leading a team. This role requires strong technical skills, excellent communication...

  • DevOps Engineer with Azure Expertise

    3 weeks ago

    Bareilly, Uttar Pradesh, India SourceBae Full time

    Job Title: DevOps Engineer with Data and Azure ExpertiseWe are seeking a skilled DevOps Engineer with a strong background in Azure Data Services and automation. The ideal candidate will have extensive experience with DevOps practices, including CI/CD pipelines, infrastructure as code (IaC) tools, and working with Azure's data and analytics technologies.Key...

  • System Engineer

    2 weeks ago

    bareilly, India Collabera Digital Full time

    About the Role:We are looking for a skilled and experienced Digital Workplace Engineer to join our team. In this role, you will be responsible for implementing the strategic design and deployment of Engineering Cloud PCs, packaging applications, and optimizing user experiences in Windows 365 Cloud Desktops. You will collaborate with IT, security, and...

  • Full Stack Engineer

    1 month ago

    bareilly, India Insight Global Full time

    Required Skills & ExperienceNode.js: Strong proficiency in Node.js for backend development.React: Experience with React for frontend development.MySQL: Solid understanding of MySQL for database management.Data Handling: Proven experience in data ingestion, translation, and API creation.Nice to Have Skills & ExperienceAdvanced React skillsExperience with...

  • Senior Software Engineer

    4 weeks ago

    Bareilly, India Wipro Full time

    Role - Sr. Engineer / Lead Engineer - Frontend DevelopmentExperience Range: 6 – 12 years.Work Location: Greater Noida / PuneHighest Regular / Fulltime Academic Qualifications: B.Tech / BE / M.Tech / MCA / MSc (computer science / IT / Data Science)Notice Period : 0 – 20 days / Immediate Job Requirements Must have hands-on experience user interface...

  • APIGEE Engineer

    3 weeks ago

    Bareilly, India KogniVera Full time

    Job Description: APIGEE Engineer (5+ Years Experience) Position: APIGEE Engineer Location: India, remoteEmployment Type: Part-Time About the Role: We are looking for an experienced APIGEE Engineer to manage and enhance API services on the APIGEE platform. The ideal candidate will have deep expertise in configuring APIGEE, exposing new services, performing...

  • Senior Quality Assurance Engineer

    3 weeks ago

    Bareilly, Uttar Pradesh, India BlockTXM Inc Full time

    About the RoleWe are seeking an experienced Senior Quality Assurance Engineer to join our team at BlockTXM Inc. This is a contract position that will focus on testing our client's platforms in conjunction with external tools.Key ResponsibilitiesLead the QA testing of our client's platforms, ensuring seamless integration with third-party systems.Develop and...