Vimal Dharmalingam
Angestellt, Data Engineer, Airnow
London, Vereinigtes Königreich
Über mich
I have honed my data analysis, data engineering, cloud computing, Data management and data coding abilities. I am an astute problem solver capable of prioritizing and completing complex projects with proficiency. In my role as Senior Data Engineer, I exercised agility, communication and python in contribution to team efforts and organizational improvements. I am open-minded and focused on new developments in my field. I have proven to be effective and motivational, with proficiency in personal effectiveness and collaborative work. I enjoy brainstorming and coordinating efforts to achieve a common goal
Werdegang
Berufserfahrung von Vimal Dharmalingam
Bis heute 1 Jahr und 11 Monate, seit Aug. 2022
Data Engineer
Airnow
. Experience summary, Design and Implementation of Data Lake for cost efficiency and optimizing performance of Data lake resources • Handling and responsible for Petabytes Level Data lake • Responsible for all clients/ Stackholders, to maintaining the data pipelines • Write Dataflow pipeline using inbuilt spaghetti framework template for data ingestion from pub Pub-Sub to Big Query • Good Experience in GCP data architecture (working with GCP support team to build the robust solution for Petabyte data
2 Jahre und 1 Monat, Aug. 2020 - Aug. 2022
Data Engineer
Swire Shipping pte Ltd
• Creating Data Lake to hold ingested raw data from streaming device • Leading/Guiding Data team which is responsible for Digital Business Analytics platform and Cloud Data migration projects • Create Big Query tables for holding various state of data using ETL processes • Providing solution for data security including Data Lineage and Data Governance and MDM Data Extraction from (20 plus) unstructured/Structured sources to integrate into GCP/AWS Data lake using Pub/Sub Subscriptions and Kafka streaming
8 Monate, Aug. 2019 - März 2020
Data Engineer
Govtech Agency Singapore
• Design and Implementation of Data Lake Data Archival for cost efficiency and optimizing performance of Data lake • Data integration between different databases like SQL, Oracle, Redshift to create aggregates tables and Analytics solutions for a business stockholder • Deploying Cloud Functions using python languages to transform raw data into desired format & event driven tasks • Dataflow and Cloud Composer to build analytics pipeline in Google Cloud • Reporting: Using POWERBI for data visualization
1 Jahr und 1 Monat, Juli 2018 - Juli 2019
Data Science Engineer
HOng Leong bank Berhad Malaysia
• Worked as a python and SQL Data Engineer • PL/SQL Development and Implementation • Involved in writing complex Oracle SQL Queries to implement business requirements • Responsible for writing store procedure, functions, packages, trigger, collections • Report Scheduler delivers reports directly to management in various report formats • They can be scheduled to arrive daily, weekly, monthly, quarterly, or annually