Data Engineer

1 month ago

india Acuity Knowledge Partners Full time

We are looking for a senior data engineer who will help us source, validate, and manage financial data using state-of-the-art data mining algorithms. The role involves leveraging the latest data mining techniques, designing validation engines, error monitoring, and conducting root cause analysis. The candidate will also be responsible for statistical analysis of our datasets and creating robust data pipelines for data consumption.


Experience : 3 - 7 Years,

Location : Bengaluru

Notice period : Immediate - 15 Days.



Responsibilities

  • Building efficient models for large-scale data extraction from websites and handling vendor-sourced data.
  • Designing, constructing, installing, testing, and maintaining data management systems.
  • Building high-performance algorithms, predictive models, and prototypes for existing and new datasets.
  • Ensuring that all systems meet the business/company requirements as well as industry practices.
  • Developing set processes for data mining, data modeling, and data production.
  • Researching new uses for existing data.
  • Collaborating with team members (like data architects, IT team, data scientists, etc.) on the project’s goals.
  • Installing/updating disaster recovery procedures and managing data security requirements.
  • Recommending ways to constantly improve data reliability and quality.
  • Designing and building validation engines for monitoring of sourced data.
  • Processing, cleansing, and verifying the integrity of data used for analysis.
  • Enhancing data collection procedures to include information that is relevant for building analytic systems.


Skills and Qualifications

  • Graduate in Engineering, Technology, Applied Mathematics, Physics, Statistics along with good business skills.
  • Proficiency in Python.
  • Experience with Financial Data, AWS, NoSQL databases, and Restful APIs.
  • Familiarity with web scraping.
  • Experience with building and maintaining data pipelines.
  • Understanding of DataOps practices.
  • Knowledge of AWS serverless CI/CD (preferred).
  • Experience with big data technologies (preferred).
  • A strong understanding of data structures and algorithms (preferred).
  • Ability to create Grafana/QuickSight dashboards for logs and data monitoring (preferred).
  • Good communication skills.
  • Good problem-solving and negotiation skills.

  • AWS Data Engineer

    2 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 days ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    7 days ago

    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Technical Lead

    2 months ago

    india Data Axle India Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...

  • Lead Data Scientist

    1 month ago

    india Data Axle India Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Lead Data Scientist

    2 months ago

    india Data Axle India Full time

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...

  • Data engineer

    3 weeks ago

    India Ryden Global Full time

    We're #hiring #Data Engineers for our USA based client at offshore in India (must support afternoon shift in IST).  Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics...

  • Data Engineer

    3 weeks ago

    India Implere Technolgies Pvt Ltd Full time

    Role Description This is a full-time remote role for a Data Engineer at Implere Technologies Pvt Ltd. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis. Qualifications Data Engineering and Data Modeling skills Experience in ETL (Extract...

  • Data Engineer

    3 weeks ago

    india Implere Technolgies Pvt Ltd Full time

    Role DescriptionThis is a full-time remote role for a Data Engineer at Implere Technologies Pvt Ltd. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis.QualificationsData Engineering and Data Modeling skillsExperience in ETL (Extract Transform...

  • Data Engineer

    3 weeks ago

    india Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST). Role DescriptionThis is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    3 weeks ago

    India Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST).  Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    3 weeks ago

    India Implere Technolgies Pvt Ltd Full time

    Role Description This is a full-time remote role for a Data Engineer at Implere Technologies Pvt Ltd. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis. Qualifications Data Engineering and Data Modeling skills Experience in ETL...

  • Data Engineer

    3 weeks ago

    India Implere Technolgies Pvt Ltd Full time

    Role DescriptionThis is a full-time remote role for a Data Engineer at Implere Technologies Pvt Ltd. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis.QualificationsData Engineering and Data Modeling skillsExperience in ETL (Extract Transform...

  • Data Engineer

    3 weeks ago

    India Implere Technolgies Pvt Ltd Full time

    Role Description This is a full-time remote role for a Data Engineer at Implere Technologies Pvt Ltd. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis. Qualifications Data Engineering and Data Modeling skills Experience in ETL (Extract...

  • Data Engineer

    4 weeks ago

    India Pitch N Hire Full time

    Tech Skills Details for IICS LeadWe are seeking a highly skilled Data Engineer to lead our team in delivering cutting-edge data solutions.Proven experience as a technical lead in data engineering projectsExtensive expertise in IDCS (Oracle Identity Cloud Service) and Informatica CloudHands-on experience with data modeling, data warehousing, and database...

  • Data Engineer

    3 weeks ago

    india Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST).  Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    3 weeks ago

    India Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST).  Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    3 weeks ago

    india Ryden Global Full time

    We're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST).  Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...