Data Engineering Lead and Data Engineers Q483

Data Engineering Lead and Data Engineers Q483

About US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for ways to improve our services and solutions. We believe in working collaboratively with our clients and employees to achieve success.

DS Technologies Inc is looking for Data Engineering Lead and Data Engineers role for one of our premier clients.

Job Title: Data Engineering Lead and Data Engineers
Location: Kantana, Ottawa, Canada (Hybrid - 3 Days Onsite from Day 1)
Industry:



Banking and Capital Markets
Job Category: Data Engineering

Overview:
We are seeking experienced Data Engineering professionals to join our team as a Data Engineering Lead and Data Engineers. The roles involve building and optimizing data pipelines, developing data solutions using Snowflake and Databricks, and ensuring data quality for enterprise-level systems. Experience in Banking and Capital Markets, particularly investment banking, is highly desirable.

Position:
Contract role (Hybrid)

Responsibilities:

- Build and optimize data pipelines for efficient data ingestion, transformation, and loading.
- Design, develop, and deploy Spark programs in Databricks to process and analyze large data volumes.
- Implement Delta Lake, data integration, and data modeling solutions.
- Develop programs using Python, PySpark, and SQL.
- Work with event-based and streaming technologies for real-time data ingestion and processing.
- Optimize Databricks jobs for performance and scalability.
- Monitor and troubleshoot Databricks jobs, resolving performance issues.




- Design and develop enterprise data warehouse solutions, including dimensional data modeling.
- Adhere to best practices for data management, security, and governance.
- Conduct code reviews to ensure optimal execution and adherence to standards.

Requirement Qualifications:

- Data Engineering Lead: 10-14 years of experience in Data Engineering.
- Data Engineer: 8-10 years of experience in Data Engineering.
- Proficiency in Snowflake, Databricks, SQL, Python, ADF, and PySpark.
- Strong expertise in data warehousing concepts, including OLTP, OLAP, dimensions, facts, and data modeling.
- Hands-on experience with ETL pipeline development using Databricks PySpark.
- Knowledge of cloud data warehouses like Synapse, BigQuery, Redshift, or Snowflake.
- Experience with Cloud-based data architectures and messaging systems.
- Cloud certifications are a plus.




- Strong skills in code optimization and performance tuning.

Additional Information:

- Hybrid role, requiring 3 days onsite in Kantana, Ottawa, Canada, from Day 1.
- Preference for candidates with experience in investment banking and enterprise-wide Cloud Data Platform migration.

Candidate Details:

- Strong technical expertise in Snowflake, Databricks, and PySpark is essential.
- Must possess leadership qualities for the Data Engineering Lead role.
- Demonstrated ability to work with structured, semi-structured, and unstructured data.

If you are interested, Kindly share your resume to [email protected] - +17035743965

Thanks
DS Technologies - Team





$RC=function(b,c,e){c=document.getElementById(c);c.parentNode.removeChild(c);var a=document.getElementById(b);if(a){b=a.previousSibling;if(e)b.data="$!",a.setAttribute("data-dgst",e);else{e=b.parentNode;a=b.nextSibling;var f=0;do{if(a&&8===a.nodeType){var d=a.data;if("/$"===d)if(0===f)break;else f--;else"$"!==d&&"$?"!==d&&"$!"!==d||f++}d=a.nextSibling;e.removeChild(a);a=d}while(a);for(;c.firstChild;)e.insertBefore(c.firstChild,a);b.data="$"}b._reactRetry&&b.;_reactRetry()}};$RC("B:0","S:0")$RC("B:1","S:1")$RC("B:2","S:2")(function(){function c(){var b=a.contentDocument||a.contentWindow.document;if(b){var d=b.createElement('script');d.nonce='d8a29ee4-2670-416d-97b9-81e9f9a9663c';d.innerHTML="window.__CF$cv$params={r:'9070bb5bcf73f3d5',t:'MTczNzcyOTEzNi4wMDAwMDA='};var a=document.createElement('script');a.nonce='d8a29ee4-2670-416d-97b9-81e9f9a9663c';a.src='/cdn-cgi/challenge-platform/scripts/jsd/main.js';document.getElementsByTagName('head')[0].appendChild(a);";b.getElementsByTagName('head')[0].appendChild(d)}}if(document.body){var a=document.createElement('iframe');a.height=1;a.width=1;a.style.position='absolute';a.style.top=0;a.style.left=0;a.style.border='none';a.style.visibility='hidden';document.body.appendChild(a);if('loading'!==document.readyState)c();else if(window.addEventListener)document.addEventListener('DOMContentLoaded',c);else{var e=document.onreadystatechange||function(){};document.onreadystatechange=function(b){e(b);'loading'!==document.readyState&&(document.onreadystatechange=e,c())}}}})();

The original job offer can be found in Kit Job:
https://www.kitjob.ca/job/90349954/data-engineering-lead-and-data-engineers-q483-gloucester/?utm_source=html