Senior Data Engineer

3 weeks ago

Kolkata, India Energy Aspects Ltd Full time
Energy Aspects currently have an exciting opportunity available for a Data Engineer to join our Data Engineering team based out of our Kolkata office. This is a fantastic opportunity for an experienced data engineer to support the ETL, data pipelines, core databases and strategic projects underpinning the work of our highly regarded global oil, natural gas and energy teams, optimizing our data content and capabilities.
The successful candidate will be responsible for building entirely new data products and maintaining/iterating on our existing datasets, data pipelines and tools in use daily at Energy Aspects by the Data and Research teams. You will take ownership of systems within a cloud-first data stack and be expected to quickly contribute to production-level Python codebases. You will closely support Data Analysts/other technical analysts, while helping to shape and drive forward the future state of data engineering at Energy Aspects.
Duties
Build/maintain data pipelines using Python
Build/extend/transform core datasets inside a SQL data warehouse
Design and implement new data solutions for use by internal teams and external clients
Support a range of strategic, company-level data initiatives
Requirements
4+ years experience as a Data Engineer
Our tech stack is predominantly:
Python: Anaconda, pandas, SQLAlchemy, web scraping libraries
SQL: PostgreSQL
Cloud: GCP, AWS
DevOps: Docker, Doppler
Orchestration: Airflow
Data visualization + apps: Plotly, dash, Flask, Retool
Experience building reliable, maintainable data pipelines
Experience with web scraping
Experience with scheduling/orchestration tools
Strong understanding of how to build, extend, query SQL databases – natively and via Python
Understanding of how to best organize and model data for storage, retrieval, and analysis
Best practice in data development: documentation, version control, testing and automation
Understanding of the importance of data governance and metadata
A methodical, analytical, and organised approach to tackling large scale projects and data sets
Effective communication skills, comfortable presenting to technical and non-technical audiences
Desirable skills
Experience cloud infrastructure, and familiarity with Infrastructure as Code
Experience with Docker/containers
Experience working with high frequency timeseries data and/or streaming data
Building and managing other database/datastore technologies (NoSQL variants, file stores, etc.)
Experience working with Python web frameworks, Jinja templating and/or JavaScript
Prior forecasting or modeling experience or training
An interest in commodities, energy or financial markets would be beneficial
About us
Founded in 2012, we are an independent research consultancy that has enjoyed phenomenal growth since our inception, and we have very ambitious plans to continue on our upwards growth trajectory. We are passionately committed to providing indispensable and industry-leading short, medium and long-term analysis, and forecasts of the energy markets, that helps our clients trade, invest, finance and plan.
With the acquisition of macro research firm Medley Global Advisors, the combination of our market-leading global macro policy analysis and deep energy markets expertise has further strengthened our services to the global financial markets and has enhanced our ability to support our expanding client base, as the energy transition gathers pace and markets look to find their feet in an uncertain future.
Our suite of subscription services can be tailored to meet our clients’ specific needs and combines a data-rich approach and our extensive network of contacts, with insight on geopolitics and energy policy to provide best-in-class assessment, analysis and forecasts of major trends, topics and regions. We also deliver timely analysis of breaking news events and offer proprietary data services that cover fundamental trade and supply/demand data, across a wide variety of products and markets.
Culture & benefits
The proud recipient of accreditation from Best Companies, we truly understand the importance of workplace engagement and genuinely value our people. We offer a fast-paced, driven, collaborative and dynamic working culture where you are recognised and rewarded for your contributions to our tremendous growth story.
We build our organisation with community in mind. All our offices are located in landmark buildings with easy access to gyms, shopping, restaurants and public transportation. As part of our Kolkata team you’ll have the opportunity to take part in the social activities taking place in this rapidly growing team.
Our compensation packages include generous commission structures, a company share options scheme, private health insurance, life assurance, income protection, pension contributions, subsidised gym membership and considerable holiday time.
Energy Aspects is proud to be an equal opportunity employer and promotes diversity within its workforce. As an international business we are determined that suitably qualified persons will never receive less favourable treatment on the grounds of gender, age, disability, religion, belief, sexual orientation, marital status, race, veteran status or any other basis covered by appropriate law.

  • Senior Data Engineer

    3 weeks ago

    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Senior Data Engineer

    3 weeks ago

    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering Primary responsibilities would include:   Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Senior Data Engineer

    3 weeks ago

    kolkata, India FinArb Consulting Full time

    Responsibilities We are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering   Primary responsibilities would include:     Investigate source data systems to build comprehensive data models to serve as Single Source of Truth Design and implement flexible, robust & scalable ETL...

  • Senior Data Engineer

    3 weeks ago

    Greater Kolkata Area, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering Primary responsibilities would include:   Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Senior Data Engineer

    3 weeks ago

    Kolkata, India Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • [3 Days Left] Senior Data Engineer

    3 days ago

    Kolkata, India FinArb Consulting Full time

    Responsibilities We are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of Truth Design and implement flexible, robust & scalable ETL infrastructure Deploy...

  • Specialist Data center operations

    4 weeks ago

    Kolkata, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Specialist Data center operations

    4 weeks ago

    Kolkata, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Senior Machine Learning Engineer

    15 hours ago

    Kolkata, West Bengal, India OptOut Full time

    Job Description :We are seeking an experienced Senior Machine Learning Engineer to join our team. The ideal candidate will have a strong background in developing production-grade machine learning models, as well as significant hands-on experience with ML technologies and techniques. The Senior Machine Learning Engineer will work closely with cross-functional...

  • Senior Machine Learning Engineer

    18 hours ago

    Kolkata, India OptOut Full time

    Job Description :We are seeking an experienced Senior Machine Learning Engineer to join our team. The ideal candidate will have a strong background in developing production-grade machine learning models, as well as significant hands-on experience with ML technologies and techniques. The Senior Machine Learning Engineer will work closely with cross-functional...

  • Senior Machine Learning Engineer

    6 hours ago

    Kolkata, India OptOut Full time

    Job Description :We are seeking an experienced Senior Machine Learning Engineer to join our team. The ideal candidate will have a strong background in developing production-grade machine learning models, as well as significant hands-on experience with ML technologies and techniques. The Senior Machine Learning Engineer will work closely with cross-functional...

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Kolkata/Pune, IN Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Senior Data Engineer

    3 weeks ago

    Bangalore,Kolkata,Pune, India Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Software Engineer-Data Engineer

    3 weeks ago

    Kolkata, India CliniSys Full time

    Essential FunctionsExtract data from on-prem databases using appropriate tools and techniques.Transform and clean the data to ensure its suitability for PowerBI analysis.Build and maintain data pipelines for regular data refresh in PowerBI.Monitor and maintain Azure Synapse pipelines for on-prem data extraction and transformation.Collaborate with analysts to...

  • Senior DevOps Engineer

    3 weeks ago

    Kolkata, India Indus Net Technologies Ltd Full time

    We are looking for a Senior DevOps Engineer to manage the software development process and create an automated delivery pipeline that assists in building software more efficiently. The responsibilities of a DevOps Engineer include assessing, supporting, and implementing high-quality information technology architecture.Responsibilities:1. Build & Release...

  • Senior Principal Consultant

    1 week ago

    Kolkata, India Genpact Full time

    A Data Architectwho can design and implement data modernization solutions in the cloud is responsible for developing and implementing data architecture strategies for organizations transitioning their data systems to the cloud. They collaborate with stakeholders to understand business requirements and translate them into scalable, secure, and high-performing...

  • Senior Project Engineer

    4 weeks ago

    Kolkata, West Bengal, India ABB Full time

    Senior Project Engineer - Metals ProcessTake your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future.At ABB, we have the clear goal of driving diversity and inclusion across all dimensions: gender, LGBTQ+, abilities, ethnicity and generations. Together, we...

  • Hiring For Data Engineer- Databricks Azure Data Factory Python

    18 hours ago

    Kolkata, West Bengal, India timesjobs Full time

    Hiring For Data Engineer- Databricks Azure Data Factory Python Job Description Data Engineer- Databricks Azure Data Factory Python Desired Profile Skills: Azure Databricks Azure Data Factory Python, implementing both structured and unstructured data, Data migration solutions, Data Warehousing, Data processing / ETL / Big data, Hadoop, Java, Spark, Scala, and...

  • Senior Data Analyst

    4 weeks ago

    Kolkata, India Energy Aspects Ltd Full time

    Energy Aspects currently have an exciting opportunity available for a Senior Data Analyst to join the Data team, based out of our Kolkata office, dedicated to supporting our energy research desks.The role will play a central role in the build-out of our data offerings and key databases. You will be required to quickly take on an array of responsibilities and...

  • Senior Data Analyst

    3 weeks ago

    kolkata, India Energy Aspects Ltd Full time

    Energy Aspects currently have an exciting opportunity available for a Senior Data Analyst to join the Data team, based out of our Kolkata office, dedicated to supporting our energy research desks. The role will play a central role in the build-out of our data offerings and key databases. You will be required to quickly take on an array of responsibilities...