Sourcebae | Data Engineer | bangalore
5 days ago
Data Engineer
Exp- 4+yrs
Contract onsite bangalore
Location:
Bangalore
TIER - 1 Btech CS is a must
Should have exp with Product based startups
About the role
As a Data Engineer for our Data Science team, you will play a critical role in helping
the team to enrich and maintain the central repository of datasets which is leveraged
for carrying out advanced data analytics and machine learning techniques to extract
actionable insights from financial and market data. You will work closely with
cross-functional teams to develop and implement robust data pipelines that will
automate the updation of data in our cloud-based repository in a ready to use form
thereby increasing data accessibility for the entire organization.
Key Responsibilities:
● ETL Development:
o Design, develop, and maintain efficient ETL processes for multi-scale data
sets.
o Implement and optimize data transformation and validation processes to
ensure data accuracy and consistency.
o Collaborate with cross-functional teams to understand data requirements and
business logic.
● Data Pipeline Architecture:
o Architect, build and maintain scalable and high-performance data pipelines
o Evaluate and implement new technologies to enhance data pipeline efficiency
and reliability
o Pipelines for extracting data through scraping for ad-hoc sector specific
datasets
● Data Modelling:
o Develop and implement data models to support analytics and reporting
needs.
o Optimize database structures for performance and scalability.
● Data Quality and Governance:
o Implement data quality checks and governance processes to ensure data
integrity.
o Collaborate with stakeholders to define and enforce data quality standards.
● Documentation and Communication:
o Document ETL processes, data models, and other relevant information.
o Communicate complex technical concepts to non-technical stakeholders
effectively.
● Cross-functional collaboration:
● Collaborate internally with the Quant team and developers to lay and optimize
the data pipelines and externally with the stakeholders to understand the
business requirements for the enrichment of the cloud database
Basic Qualifications
● Bachelor's degree in Computer Science, Information Technology, or a related field.
● Proven experience as a Data Engineer with expertise in ETL techniques (2+ years) is
a MUST
● Strong programming skills in languages such as Python, Java, or Scala.
● Skillset to scrape and transform data off of the publicly available web sources
● Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).
● Proficiency in SQL and experience working with relational and non-relational
databases.
● Knowledge of data warehousing concepts and architectures.
● Familiarity with big data technologies such as Hadoop, Spark, and Kafka.
● Experience with data modeling tools and techniques.
● Excellent problem-solving and analytical skills.
● Strong communication and collaboration skills.
4. Responsibilities:
o Outline the primary responsibilities and tasks the candidate is expected to
perform.
Preferred Qualifications
● Master's degree or equivalent in Computer Science/ Data Science
● Knowledge of data streaming and real-time processing.
● Familiarity with data governance and security best practices.
If Intrested. Please submit your CV to or share it via WhatsApp at 8827565832
Stay updated with our latest job opportunities and company news by following us on LinkedIn: :
-
Sourcebae | Data Engineer | bangalore
4 days ago
bangalore, India Sourcebae Full timeData EngineerExp- 4+yrsContract onsite bangaloreLocation:BangaloreTIER - 1 Btech CS is a mustShould have exp with Product based startupsAbout the roleAs a Data Engineer for our Data Science team, you will play a critical role in helpingthe team to enrich and maintain the central repository of datasets which is leveragedfor carrying out advanced data...
-
bangalore, India SourceBae Full timeJob Title: Data Warehouse – DBA (Snowflake, AWS)Location: BangaloreWork Mode: Hybrid (At least 3 days a week from the office)Experience: 12-20 years (Designer experience mandatory)Role Summary:We are seeking experienced Data Warehouse DBAs with strong expertise in Snowflake and AWS. The ideal candidate will have a proven background in database design,...
-
bangalore, India SourceBae Full timeJob Title: Data Warehouse – DBA (Snowflake, AWS) Location: Bangalore Work Mode: Hybrid (At least 3 days a week from the office) Experience: 12-20 years (Designer experience mandatory) Role Summary: We are seeking experienced Data Warehouse DBAs with strong expertise in Snowflake and AWS. The ideal candidate will have a proven background in database...
-
SourceBae | Java Developer | bangalore
4 weeks ago
bangalore, India SourceBae Full timeTitle: Java Developer Location: India (Chennai, Bangalore, Kochi )- Hybrid Position Summary: Our dynamic team is seeking a Full Stack Developer proficient in SOLID principles and experienced in developing distributed, Event Driven applications. The ideal candidate should be a skilled programmer with expertise in at least one of the following languages: Java,...
-
SourceBae | AWS Platform Engineer | bangalore
3 weeks ago
bangalore, India SourceBae Full timeJob Title: AWS Platform EngineerLocation: Bangalore / RemoteExperience: 7+ yearsAbout the Role:We are seeking an experienced AWS Platform Engineer to architect, manage, and optimize cloud environments in regulated industries, including finance. This is an exciting opportunity to work with cutting-edge technologies while ensuring the security, scalability,...
-
SourceBae | AWS Platform Engineer | bangalore
3 weeks ago
bangalore, India SourceBae Full timeJob Title: AWS Platform Engineer Location: Bangalore / Remote Experience: 7+ years About the Role: We are seeking an experienced AWS Platform Engineer to architect, manage, and optimize cloud environments in regulated industries, including finance. This is an exciting opportunity to work with cutting-edge technologies while ensuring the security,...
-
Sourcebae | Quality Assurance Engineer | bangalore
21 hours ago
bangalore, India Sourcebae Full timePosition- QAMust Have Skills:● 7+ years of experience in a quality engineering role.● Hands-on experience with Java and related technologies.● Knowledge of tools, concepts, and methodologies of testing and where each oneapplies.● Experience in automation scripting using tools such as Selenium, REST assured, Appium,and TestNG. In addition, having...
-
bangalore, India Sourcebae Full timePosition- QA Must Have Skills: ● 7+ years of experience in a quality engineering role. ● Hands-on experience with Java and related technologies. ● Knowledge of tools, concepts, and methodologies of testing and where each one applies. ● Experience in automation scripting using tools such as Selenium, REST assured, Appium, and TestNG. In addition,...
-
SourceBae | Pyspark Developer | bangalore
4 weeks ago
bangalore, India SourceBae Full timeJob Title: Senior Pyspark Developer Job Description: 5+ years of experience in Pyspark including Hadoop, SQL and other big data technologies. Databricks knowledge is fine. We are seeking a skilled PySpark Developer to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics using PySpark. Additionally,...
-
bangalore, India SourceBae Full timeTC Architect (10+ years of experience) Location - Hyderabad, Pune, Chennai, Bangalore/ Mode - Hybrid Profile: Teamcenter Solution Architect Experience: Solution design, development in Teamcenter PLM, AWC; customization in client and server, SOA client development Skills: ITK, RAC, C++ based SOA services, REST APIs, Java, XML, XSLT, BMIDE Modules: Structure...
-
SourceBae | Golang developer | bangalore
3 weeks ago
bangalore, India SourceBae Full timeGoLang Developer Location: Onsite Role Overview: We are looking for an experienced GoLang Developer to join our team. The ideal candidate will have a strong background in backend development and be adept at creating robust, scalable solutions using Go. If you're passionate about working on cutting-edge technology and eager to make a meaningful impact,...
-
SourceBae | Golang developer | bangalore
3 weeks ago
bangalore, India SourceBae Full timeGoLang DeveloperLocation: Onsite Role Overview: We are looking for an experienced GoLang Developer to join our team. The ideal candidate will have a strong background in backend development and be adept at creating robust, scalable solutions using Go. If you're passionate about working on cutting-edge technology and eager to make a meaningful impact, we’d...
-
SourceBae | Senior Lead Developer | bangalore
2 weeks ago
bangalore, India SourceBae Full timeJob Title: Senior Developer/Lead - Angular Experience: 7+ years Work Location: Bangalore/Mangalore Education Qualification: BE/B.Tech/MCA/M.Sc/M.Tech Core Technical Expertise: Must have : NgRx and RxJs Job description: Advanced proficiency in HTML5, CSS3, JavaScript, TypeScript, and Angular (Version 2 and above). Deep understanding and hands-on...
-
bangalore, India SourceBae Full timeJob Title: Senior Developer/Lead - AngularExperience: 7+ yearsWork Location: Bangalore/MangaloreEducation Qualification: BE/B.Tech/MCA/M.Sc/M.TechCore Technical Expertise:Must have : NgRx and RxJsJob description:Advanced proficiency in HTML5, CSS3, JavaScript, TypeScript, and Angular (Version 2 and above).Deep understanding and hands-on experience with NgRx...
-
SourceBae | Senior Lead Developer | bangalore
2 weeks ago
bangalore, India SourceBae Full timeJob Title: Senior Developer/Lead - Angular Experience: 7+ yearsWork Location: Bangalore/MangaloreEducation Qualification: BE/B.Tech/MCA/M.Sc/M.TechCore Technical Expertise: Must have : NgRx and RxJsJob description:Advanced proficiency in HTML5, CSS3, JavaScript, TypeScript, and Angular (Version 2 and above).Deep understanding and hands-on experience with...
-
Data Engineer
4 days ago
Bangalore, India Sourcebae Full timeData Engineer Exp- 4+yrs Contract onsite bangalore Location: Bangalore TIER - 1 Btech CS is a must Should have exp with Product based startups About the role As a Data Engineer for our Data Science team, you will play a critical role in helping the team to enrich and maintain the central repository of datasets which is leveraged for...
-
bangalore, India Bangalore Electronics Full timeCompany Description Distributors & System Integrator at Bangalore Electronics specialize in Electronics Components, Video Surveillance, Video Intercoms, Access Control Systems, Active & Passive Networking, and Data Centre Infrastructure. The company is located in Bengaluru, India, and offers diverse electronic solutions to cater to various industries and...
-
Tatras Data | Data Analyst
2 days ago
bangalore, India Tatras Data Full timeTatras Data, an emerging player in Data Science and Artificial Intelligence is looking to hire multiple data analysts. Location: Bangalore/Hyderabad (Hybrid – 3 days in office) Experience Required: 3+ relevant years of experience Educational Qualification: B.Tech, B.Sc., or Software Engineering Key Skills and Requirements: ● Programming Expertise:...
-
Tatras Data | Data Analyst
3 days ago
bangalore, India Tatras Data Full timeTatras Data, an emerging player in Data Science and Artificial Intelligence is looking to hire multiple dataanalysts.Location: Bangalore/Hyderabad (Hybrid – 3 days in office)Experience Required: 3+ relevant years of experienceEducational Qualification: B.Tech, B.Sc., or Software EngineeringKey Skills and Requirements:● Programming Expertise: Strong...
-
Network Engineer
4 weeks ago
bangalore, India Bangalore Electronics Full timeCompany Description Distributors & System Integrator at Bangalore Electronics specialize in Electronics Components, Video Surveillance, Video Intercoms, Access Control Systems, Active & Passive Networking, and Data Centre Infrastructure. The company is located in Bengaluru, India, and offers diverse electronic solutions to cater to various industries and...