Sourcebae | Data Engineer | bangalore

5 days ago


bangalore, India Sourcebae Full time

Data Engineer

Exp- 4+yrs

Contract onsite bangalore


Location:

Bangalore


TIER - 1 Btech CS is a must

Should have exp with Product based startups

About the role

As a Data Engineer for our Data Science team, you will play a critical role in helping

the team to enrich and maintain the central repository of datasets which is leveraged

for carrying out advanced data analytics and machine learning techniques to extract

actionable insights from financial and market data. You will work closely with

cross-functional teams to develop and implement robust data pipelines that will

automate the updation of data in our cloud-based repository in a ready to use form

thereby increasing data accessibility for the entire organization.


Key Responsibilities:

● ETL Development:

o Design, develop, and maintain efficient ETL processes for multi-scale data

sets.

o Implement and optimize data transformation and validation processes to

ensure data accuracy and consistency.

o Collaborate with cross-functional teams to understand data requirements and

business logic.

● Data Pipeline Architecture:

o Architect, build and maintain scalable and high-performance data pipelines

o Evaluate and implement new technologies to enhance data pipeline efficiency

and reliability

o Pipelines for extracting data through scraping for ad-hoc sector specific

datasets

● Data Modelling:

o Develop and implement data models to support analytics and reporting

needs.

o Optimize database structures for performance and scalability.

● Data Quality and Governance:

o Implement data quality checks and governance processes to ensure data

integrity.

o Collaborate with stakeholders to define and enforce data quality standards.

● Documentation and Communication:

o Document ETL processes, data models, and other relevant information.

o Communicate complex technical concepts to non-technical stakeholders

effectively.

● Cross-functional collaboration:

● Collaborate internally with the Quant team and developers to lay and optimize

the data pipelines and externally with the stakeholders to understand the

business requirements for the enrichment of the cloud database


Basic Qualifications

● Bachelor's degree in Computer Science, Information Technology, or a related field.

● Proven experience as a Data Engineer with expertise in ETL techniques (2+ years) is

a MUST

● Strong programming skills in languages such as Python, Java, or Scala.

● Skillset to scrape and transform data off of the publicly available web sources

● Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).

● Proficiency in SQL and experience working with relational and non-relational

databases.

● Knowledge of data warehousing concepts and architectures.

● Familiarity with big data technologies such as Hadoop, Spark, and Kafka.

● Experience with data modeling tools and techniques.

● Excellent problem-solving and analytical skills.

● Strong communication and collaboration skills.

4. Responsibilities:

o Outline the primary responsibilities and tasks the candidate is expected to

perform.


Preferred Qualifications

● Master's degree or equivalent in Computer Science/ Data Science

● Knowledge of data streaming and real-time processing.

● Familiarity with data governance and security best practices.


If Intrested. Please submit your CV to or share it via WhatsApp at 8827565832


Stay updated with our latest job opportunities and company news by following us on LinkedIn: :



  • bangalore, India Sourcebae Full time

    Data EngineerExp- 4+yrsContract onsite bangaloreLocation:BangaloreTIER - 1 Btech CS is a mustShould have exp with Product based startupsAbout the roleAs a Data Engineer for our Data Science team, you will play a critical role in helpingthe team to enrich and maintain the central repository of datasets which is leveragedfor carrying out advanced data...


  • bangalore, India SourceBae Full time

    Job Title: Data Warehouse – DBA (Snowflake, AWS)Location: BangaloreWork Mode: Hybrid (At least 3 days a week from the office)Experience: 12-20 years (Designer experience mandatory)Role Summary:We are seeking experienced Data Warehouse DBAs with strong expertise in Snowflake and AWS. The ideal candidate will have a proven background in database design,...


  • bangalore, India SourceBae Full time

    Job Title: Data Warehouse – DBA (Snowflake, AWS) Location: Bangalore Work Mode: Hybrid (At least 3 days a week from the office) Experience: 12-20 years (Designer experience mandatory) Role Summary: We are seeking experienced Data Warehouse DBAs with strong expertise in Snowflake and AWS. The ideal candidate will have a proven background in database...


  • bangalore, India SourceBae Full time

    Title: Java Developer Location: India (Chennai, Bangalore, Kochi )- Hybrid Position Summary: Our dynamic team is seeking a Full Stack Developer proficient in SOLID principles and experienced in developing distributed, Event Driven applications. The ideal candidate should be a skilled programmer with expertise in at least one of the following languages: Java,...


  • bangalore, India SourceBae Full time

    Job Title: AWS Platform EngineerLocation: Bangalore / RemoteExperience: 7+ yearsAbout the Role:We are seeking an experienced AWS Platform Engineer to architect, manage, and optimize cloud environments in regulated industries, including finance. This is an exciting opportunity to work with cutting-edge technologies while ensuring the security, scalability,...


  • bangalore, India SourceBae Full time

    Job Title: AWS Platform Engineer Location: Bangalore / Remote Experience: 7+ years About the Role: We are seeking an experienced AWS Platform Engineer to architect, manage, and optimize cloud environments in regulated industries, including finance. This is an exciting opportunity to work with cutting-edge technologies while ensuring the security,...


  • bangalore, India Sourcebae Full time

    Position- QAMust Have Skills:● 7+ years of experience in a quality engineering role.● Hands-on experience with Java and related technologies.● Knowledge of tools, concepts, and methodologies of testing and where each oneapplies.● Experience in automation scripting using tools such as Selenium, REST assured, Appium,and TestNG. In addition, having...


  • bangalore, India Sourcebae Full time

    Position- QA Must Have Skills: ● 7+ years of experience in a quality engineering role. ● Hands-on experience with Java and related technologies. ● Knowledge of tools, concepts, and methodologies of testing and where each one applies. ● Experience in automation scripting using tools such as Selenium, REST assured, Appium, and TestNG. In addition,...


  • bangalore, India SourceBae Full time

    Job Title: Senior Pyspark Developer Job Description: 5+ years of experience in Pyspark including Hadoop, SQL and other big data technologies. Databricks knowledge is fine. We are seeking a skilled PySpark Developer to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics using PySpark. Additionally,...


  • bangalore, India SourceBae Full time

    TC Architect (10+ years of experience) Location - Hyderabad, Pune, Chennai, Bangalore/ Mode - Hybrid Profile: Teamcenter Solution Architect Experience: Solution design, development in Teamcenter PLM, AWC; customization in client and server, SOA client development Skills: ITK, RAC, C++ based SOA services, REST APIs, Java, XML, XSLT, BMIDE Modules: Structure...


  • bangalore, India SourceBae Full time

    GoLang Developer Location: Onsite Role Overview: We are looking for an experienced GoLang Developer to join our team. The ideal candidate will have a strong background in backend development and be adept at creating robust, scalable solutions using Go. If you're passionate about working on cutting-edge technology and eager to make a meaningful impact,...


  • bangalore, India SourceBae Full time

    GoLang DeveloperLocation: Onsite Role Overview: We are looking for an experienced GoLang Developer to join our team. The ideal candidate will have a strong background in backend development and be adept at creating robust, scalable solutions using Go. If you're passionate about working on cutting-edge technology and eager to make a meaningful impact, we’d...


  • bangalore, India SourceBae Full time

    Job Title: Senior Developer/Lead - Angular Experience: 7+ years Work Location: Bangalore/Mangalore Education Qualification: BE/B.Tech/MCA/M.Sc/M.Tech Core Technical Expertise: Must have : NgRx and RxJs Job description: Advanced proficiency in HTML5, CSS3, JavaScript, TypeScript, and Angular (Version 2 and above). Deep understanding and hands-on...


  • bangalore, India SourceBae Full time

    Job Title: Senior Developer/Lead - AngularExperience: 7+ yearsWork Location: Bangalore/MangaloreEducation Qualification: BE/B.Tech/MCA/M.Sc/M.TechCore Technical Expertise:Must have : NgRx and RxJsJob description:Advanced proficiency in HTML5, CSS3, JavaScript, TypeScript, and Angular (Version 2 and above).Deep understanding and hands-on experience with NgRx...


  • bangalore, India SourceBae Full time

    Job Title: Senior Developer/Lead - Angular Experience: 7+ yearsWork Location: Bangalore/MangaloreEducation Qualification: BE/B.Tech/MCA/M.Sc/M.TechCore Technical Expertise: Must have : NgRx and RxJsJob description:Advanced proficiency in HTML5, CSS3, JavaScript, TypeScript, and Angular (Version 2 and above).Deep understanding and hands-on experience with...

  • Data Engineer

    4 days ago


    Bangalore, India Sourcebae Full time

    Data Engineer Exp- 4+yrs Contract onsite bangalore Location: Bangalore TIER - 1 Btech CS is a must Should have exp with Product based startups About the role As a Data Engineer for our Data Science team, you will play a critical role in helping the team to enrich and maintain the central repository of datasets which is leveraged for...


  • bangalore, India Bangalore Electronics Full time

    Company Description Distributors & System Integrator at Bangalore Electronics specialize in Electronics Components, Video Surveillance, Video Intercoms, Access Control Systems, Active & Passive Networking, and Data Centre Infrastructure. The company is located in Bengaluru, India, and offers diverse electronic solutions to cater to various industries and...


  • bangalore, India Tatras Data Full time

    Tatras Data, an emerging player in Data Science and Artificial Intelligence is looking to hire multiple data analysts. Location: Bangalore/Hyderabad (Hybrid – 3 days in office) Experience Required: 3+ relevant years of experience Educational Qualification: B.Tech, B.Sc., or Software Engineering Key Skills and Requirements: ● Programming Expertise:...


  • bangalore, India Tatras Data Full time

    Tatras Data, an emerging player in Data Science and Artificial Intelligence is looking to hire multiple dataanalysts.Location: Bangalore/Hyderabad (Hybrid – 3 days in office)Experience Required: 3+ relevant years of experienceEducational Qualification: B.Tech, B.Sc., or Software EngineeringKey Skills and Requirements:● Programming Expertise: Strong...

  • Network Engineer

    4 weeks ago


    bangalore, India Bangalore Electronics Full time

    Company Description Distributors & System Integrator at Bangalore Electronics specialize in Electronics Components, Video Surveillance, Video Intercoms, Access Control Systems, Active & Passive Networking, and Data Centre Infrastructure. The company is located in Bengaluru, India, and offers diverse electronic solutions to cater to various industries and...