|
Data Engineers » Canberra, ACT - Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3+ years of experience in data engineering... Data Officer and the agency to create a data-driven culture that identifies external trends to inform strategic decisions... • Tue, 04 Jun • CYOS Solutions Data Engineer Jobs. Big Data Engineer. Analytics Engineer | Data Engineer » The Rocks, Sydney - What we're all about. It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually stimulating. We're a real team. Collaborating and constantly engineering better and better solutions. We're ambitious, we think things through and we're on a mission to discover just how far we can go. Nearly half of our colleagues come from an ethnic or religious minority background. We're made up of people from 47 nationalities who speak over 20 languages. As a diverse mix of individuals, we make one big unstoppable team. If our incredible culture sounds like you, we'd love you to join us. The opportunity. Our Quantexa Delivery team is all about contextualizing data. As a data engineer, you bring it all together. Working within a fast-paced team, you'll implement Quantexa's innovative technology for an ever-expanding list of domains including banking, insurance, government, healthcare. From building an end-to-end data pipeline that uses our award-winning software, to configuring our decision-making platform to detect key insights, there's always a new challenge around the corner. You'll need to be a problem solver. The challenges we tackle are big, but they're also incredibly rewarding. Your contributions in managing, transforming, and cleansing high volume data help our clients solve business problems in areas including fraud, financial crime, data management, risk and customer intelligence. What you'll be doing. Writing defensive, fault tolerant and efficient code for production level data processing systems. Configuring and deploying Quantexa software using tools such as Spark, Hadoop, Scala, Elasticsearch, with our platform being hosted on both private and public virtual clouds, such as Google cloud, Microsoft Azure and Amazon. You'll be a trusted source of knowledge for your clients. And you'll articulate technical concepts to a non-technical audience so they can make key decisions. Collaborate with both our solution architects and our R&D engineers to champion solutions and standards for complex big data challenges. You proactively promote knowledge sharing and ensure best practice is followed. • Sat, 08 Jun • Quantexa | Data Engineer » Australian Capital Territory - . Demonstrated data engineer experience, including: in developing, configuring, validating, and managing Microsoft cloud platforms...Seeking experienced Data Migration professionals Contract to June 2025 Must be an Australian Citizen Our Client... • Sat, 08 Jun | Data Centre and Communications Rooms Engineer » Canberra, ACT - Title: Data Centre and Communications Rooms Engineer Division: Information Technology Services Classification: ANU... and communications room engineer to support our small team in providing efficient and effective data centre and network room environment... • Sat, 08 Jun • Australian National University • $97707 - 102600 per year | Data Center Technical Operations Engineer, Infraops DCEO » Sydney, NSW - DESCRIPTION The Facility Engineer with be responsible for Data Center Engineering Operations within an Amazon Data..., AUS BASIC QUALIFICATIONS - High school or equivalent diploma PREFERRED QUALIFICATIONS - Experience in data center... • Fri, 07 Jun • Amazon | Related Jobs in Australia
| Data Center Technical Operations Engineer, Infraops DCEO » Sydney, NSW - DESCRIPTION The Facility Engineer with be responsible for Data Center Engineering Operations within an Amazon Data... experience. - 6+ years of Data Center Engineering/Operations Experience - 4+ years of Data Center Management Experience... • Fri, 07 Jun • Amazon | Data Engineer » Sydney, NSW - . Our Quantexa Delivery team is all about contextualizing data. As a data engineer, you bring it all together. Working within a fast..., has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle... • Thu, 06 Jun • Quantexa | Senior Data Modeller/Engineer » Sydney, NSW - Role: Senior Data Modeller/ Engineer Daily Rate: $1100 - $1150 + Super Contract Length: 6 months Locations: Sydney.../WFH As Senior Report Developer/ Engineer, you'll be responsible for understanding data and transforming it into business... • Thu, 06 Jun • Talenza | Data Engineer » Macquarie University, NSW - Data Engineer Permanent full time position Based in Macquarie University - Hybrid work arrangement Join Hearing... people through hearing health when and where they need it. Your opportunity We are seeking an experienced Data Engineer... • Thu, 06 Jun • Australian Hearing | Staff Data Engineer » Sydney, NSW - Staff Data Engineer You are determined to stay ahead of the latest Big Data, Ab Initio and Datawarehouse technologies... engineer with proven expertise in software development and a passion for providing data-driven solutions, you’re ahead... • Thu, 06 Jun • Commonwealth Bank of Australia | Data Engineer » Sydney, NSW - . Our Quantexa Delivery team is all about contextualizing data. As a data engineer, you bring it all together. Working within a fast... data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal... • Thu, 06 Jun • Quantexa | Data Engineers » Brisbane, Brisbane Region - Application closing date: Friday, 14 June 2024 - 11:59pm, Canberra time Estimated start date: Monday, 01 July 2024 Location of work: QLD Working arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability. Interstate candidates will also be considered. However, there will be a requirement to attend workshops, meetings and other on-site duties as directed from time to time. Length of contract: 12 months Contract extensions: 1 x 12 months Security clearance: Must be able to obtain Baseline clearance Rates: $110 - $140 per hour (inc. super) The Clean Energy Regulator is inclusive and agile, with staff at all levels being part of conversations with the senior executive and being offered the opportunity to experience different types of work. We pride ourselves on our diverse and inclusive workplace. If you're Aboriginal or Torres Strait Islander peoples, living with disability or a mature age worker, we encourage you to apply. The role of the Transformation Office is to provide insights, solutions and advice to decision makers, policy makers and the market to improve scheme operations and position the agency as a modern, efficient and effective regulator. Branch objectives: - Provide advice, capability uplift and support to the agency's transformation Program design and implementation that is viable, desirable and sustainable. - Create a renewed focus on synergising interdependencies, maturing governance, driving business transition and benefits realisation through the CER Change Program. - Support the Chief Data Officer and the agency to create a data-driven culture that identifies external trends to inform strategic decisions and support business transformation. - Model and embed best practice across portfolio, program and project management in delivering our strategic objectives and outcomes for the agency. The Data Innovation and Tools section supports the agency to unlock the potential of our data to drive innovation and compliance for the agency. Specific responsibilities include: - Support the Chief Data Officer and the agency in delivering the Data and Reporting Strategy to improve data governance. - Support business areas to improve data transparency under the agency's open data policy. - Promote and facilitate sharing of scheme data across Commonwealth agencies. - Provide a point of liaison between the Digital Services branch and business areas on the delivery of data services infrastructure under the Data Services Roadmap. - Build agency analytics capability, and utilise data analytics and geospatial analytics to: » Support the integrity of agency schemes by detecting, predicting and preventing non-compliance. » Provide insights and evidence to decision-makers and other stakeholders on the behaviour of our clients and the trends and outcomes in our schemes. » Identify and deliver business improvements and efficiencies. » Support innovative approaches to reduce regulatory burden, support self-service approaches, improve efficiency and encourage compliance with our schemes - by: Working with business areas to identify, prioritise and implement innovative approaches to scheme and participant needs or problems. Provide targeted skills and resources to consult on, design, build and/or roll out strategic initiatives that result in improvements to internal processes, data collection, client compliance, and communication related to scheme operations. Role Responsibilities and Duties - Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. - Develop scalable architecture practices for pipeline designs. - Lead data migration and integration for critical change programs. - Ensure data integrity and align engineering tasks with program objectives. - Mentor team members and drive new data engineering practices adoption. - Monitor and improve data service performance and costs. - Maintain documentation and adhere to data governance policies. - Research and innovate within the Azure data engineering field. Qualifications/Experience - Bachelor's degree in computer science, Engineering, or a related field. - Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. - 3 years of experience in data engineering with a focus on Azure services. - Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. - Demonstrated ability to design and implement scalable data architectures. - Experience in data migration and managing large-scale data pipelines. - Familiarity with DevOps practices and tools within the Azure ecosystem. - Strong technical skills in SQL, Python, and R - Proficiency in data modelling including reuse and scalability patterns - Knowledge of Azure Monitor, Azure Security, and compliance frameworks. - Ability to work with cross-functional teams and lead technical projects. - Experience building data profiling, data cleansing and data engineering frameworks. - Will require Australian Citizenship with a Baseline Security clearance as a minimum. HOW TO APPLY Please provide an updated CV and provide a 500 word response to your ability to meet the skills, competencies and characteristics that reflects your suitability to the role based on the job description above. • Thu, 06 Jun • CYOS Solutions | Data Engineer » The Rocks, Sydney - What we’re all about. It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually stimulating. We’re a real team. Collaborating and constantly engineering better and better solutions. We’re ambitious, we think things through and we’re on a mission to discover just how far we can go. Nearly half of our colleagues come from an ethnic or religious minority background. We’re made up of people from 47 nationalities who speak over 20 languages. As a diverse mix of individuals, we make one big unstoppable team. If our incredible culture sounds like you, we’d love you to join us. The opportunity. Our Quantexa Delivery team is all about contextualizing data. As a data engineer, you bring it all together. Working within a fast-paced team, you'll implement Quantexa’s innovative technology for an ever-expanding list of domains including banking, insurance, government, healthcare. From building an end-to-end data pipeline that uses our award-winning software, to configuring our decision-making platform to detect key insights, there’s always a new challenge around the corner. You’ll need to be a problem solver. The challenges we tackle are big, but they're also incredibly rewarding. Your contributions in managing, transforming, and cleansing high volume data help our clients solve business problems in areas including fraud, financial crime, data management, risk and customer intelligence. What you’ll be doing. Writing defensive, fault tolerant and efficient code for production level data processing systems. Configuring and deploying Quantexa software using tools such as Spark, Hadoop, Scala, Elasticsearch, with our platform being hosted on both private and public virtual clouds, such as Google cloud, Microsoft Azure and Amazon. You’ll be a trusted source of knowledge for your clients. And you’ll articulate technical concepts to a non-technical audience so they can make key decisions. Collaborate with both our solution architects and our R&D engineers to champion solutions and standards for complex big data challenges. You proactively promote knowledge sharing and ensure best practice is followed. Requirements What you’ll bring. You’ll have a background in hands-on technical development, with at least 18 months' of industry experience in a data engineering role or equivalent, and preferably some software industry experience. Proficiency in Scala, java, python, or a programming language associated with data engineering. Our primary language is Scala, but don’t worry if that’s not currently your strongest language. We believe that strong engineering principles are universal and transferable. As an expert in building and deploying production level data processing batch systems, you’ll share an appreciation of what makes a high quality, operationally stable system and how to streamline all areas of development, release, and operations to achieve this. Experience with a variety of modern development tooling (e.g. Git, Gradle, Nexus) and technologies supporting automation and DevOps (e.g. Jenkins, Docker and a little bit of good old Bash scripting). You’ll be familiar with developing within a version-controlled process that regularly makes use of these tools and technologies. A strong technical communication ability with demonstrable experience of working in rapidly changing client environments. Knowledge of testing libraries of common programming languages (such as ScalaTest or equivalent). Importantly, you’ll know the difference between varying test types (unit test, integration test) and can cite specific examples of what they have written themselves. Benefits Our perks and quirks. What makes you Q will help you to realize your full potential, flourish and enjoy what you do, while being recognized and rewarded with our broad range of benefits. Competitive salary Company bonus 11% Superannuation Private healthcare with Medibank Dental, Orthodontics & Optics Cover Free Calm App Subscription 1 app for meditation, relaxation and sleep ♀️ 20 days annual leave, 13 national holidays birthday off Ongoing personal development Our mission. We have one mission. To help businesses grow. To make data easier. And to make the world a better place. We’re not a start-up. Not anymore. But we’ve not been around that long either. What we are is a collection of bright, passionate minds harnessing complexities and helping our clients and their communities. One culture, made of many. Heading in one direction – the future. It’s all about you. It’s important to us that you feel welcome, valued and respected. After all, it’s your individuality and passion for what you do that will make you Q. We see that – which is why we’re proud to be an Equal Opportunity Employer. We’ve created and will continue to improve our inclusive and diverse work environment. Regardless of your race, beliefs, color, national origin, gender, sexual orientation, age, marital status, neurodiversity or ableness – whoever you are – if you are a passionate, curious and caring human being who wants to push the boundaries of what’s possible, then we want to hear from you. start. don’t stop – Apply • Thu, 06 Jun • Quantexa | Senior Data Engineer - Hawthorn East » Hawthorn East, VIC - East Melbourne, VIC - of Aussie lives-you'll also get to see your impact. Senior Data Engineer (122144) Want to discover opportunities.... We are looking for a Senior Data Engineer to join our growing Data and Business Intelligence team to continue to build our future data... • Wed, 05 Jun • Coles Group | Data Engineer » Canberra, ACT - Data Engineer 900-1000 per Day Canberra - Hybrid As a Data Engineer for a leading agency, you will unlock data... Engineer Responsibilities: Create and enhance data lakes, CI/CD, and Synapse pipelines using the Azure stack. Establish... • Wed, 05 Jun • Certus Recruitment | Data Engineer » Brisbane, QLD - An opportunity to join the data analytics platform development team of a global company in Brisbane as a Data Engineer... Responsibilities Design, build, and deploy the data lake using latest technologies Manage and scale data pipelines and analytics... • Wed, 05 Jun • Peoplebank | Data Engineer » Sydney, NSW - Pyrmont, NSW - Data Engineer (also known as BI Developer, Quantitative Data Engineer, Search Engineer, Technical Architect, Big Data... Analyst, Solutions Architect, Data Warehouse Engineer, Data Science Software Engineer, ETL Developer) The role of the Data... • Wed, 05 Jun • Publicis Groupe | Data Engineers » Adelaide, Adelaide Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline. Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable architecture practices for pipeline designs. Lead data migration and integration for critical change programs. Ensure data integrity and align engineering tasks with program objectives. Mentor team members and drive new data engineering practices adoption. Monitor and improve data service performance and costs. Maintain documentation and adhere to data governance policies. Research and innovate within the Azure data engineering field. Qualifications/Experience: Bachelors degree in computer science, Engineering, or a related field. Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3 years of experience in data engineering with a focus on Azure services. Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. Demonstrated ability to design and implement scalable data architectures. Experience in data migration and managing large-scale data pipelines. Familiarity with DevOps practices and tools within the Azure ecosystem. Strong technical skills in SQL, Python, and R Proficiency in data modelling including reuse and scalability patterns Knowledge of Azure Monitor, Azure Security, and compliance frameworks. Ability to work with cross-functional teams and lead technical projects. Experience building data profiling, data cleansing and data engineering frameworks Address Each Selection criteria to support your application(one page summary) Essential criteria 1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description. Desirable criteria The extent to which the proposed fees represent value for money to the CER. • Wed, 05 Jun • Softtest pays pty ltd | Data Engineers » Hobart, Hobart Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline. Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable architecture practices for pipeline designs. Lead data migration and integration for critical change programs. Ensure data integrity and align engineering tasks with program objectives. Mentor team members and drive new data engineering practices adoption. Monitor and improve data service performance and costs. Maintain documentation and adhere to data governance policies. Research and innovate within the Azure data engineering field. Qualifications/Experience: Bachelors degree in computer science, Engineering, or a related field. Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3 years of experience in data engineering with a focus on Azure services. Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. Demonstrated ability to design and implement scalable data architectures. Experience in data migration and managing large-scale data pipelines. Familiarity with DevOps practices and tools within the Azure ecosystem. Strong technical skills in SQL, Python, and R Proficiency in data modelling including reuse and scalability patterns Knowledge of Azure Monitor, Azure Security, and compliance frameworks. Ability to work with cross-functional teams and lead technical projects. Experience building data profiling, data cleansing and data engineering frameworks Address Each Selection criteria to support your application(one page summary) Essential criteria 1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description. Desirable criteria The extent to which the proposed fees represent value for money to the CER. • Wed, 05 Jun • Softtest pays pty ltd | Data Engineers » Brisbane, Brisbane Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable architecture practices for pipeline designs. Lead data migration and integration for critical change programs. Ensure data integrity and align engineering tasks with program objectives. Mentor team members and drive new data engineering practices adoption. Monitor and improve data service performance and costs. Maintain documentation and adhere to data governance policies. Research and innovate within the Azure data engineering field. Qualifications/Experience: Bachelors degree in computer science, Engineering, or a related field. Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3 years of experience in data engineering with a focus on Azure services. Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. Demonstrated ability to design and implement scalable data architectures. Experience in data migration and managing large-scale data pipelines. Familiarity with DevOps practices and tools within the Azure ecosystem. Strong technical skills in SQL, Python, and R Proficiency in data modelling including reuse and scalability patterns Knowledge of Azure Monitor, Azure Security, and compliance frameworks. Ability to work with cross-functional teams and lead technical projects. Experience building data profiling, data cleansing and data engineering frameworks. Address Each Selection criteria to support your application(one page summary) Address Each Selection criteria to support your application(one page summary) Essential criteria 1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description. Desirable criteria The extent to which the proposed fees represent value for money to the CER. • Wed, 05 Jun • Softtest pays pty ltd | Data Engineers » Darwin, Darwin Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline. Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable architecture practices for pipeline designs. Lead data migration and integration for critical change programs. Ensure data integrity and align engineering tasks with program objectives. Mentor team members and drive new data engineering practices adoption. Monitor and improve data service performance and costs. Maintain documentation and adhere to data governance policies. Research and innovate within the Azure data engineering field. Qualifications/Experience: Bachelors degree in computer science, Engineering, or a related field. Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3 years of experience in data engineering with a focus on Azure services. Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. Demonstrated ability to design and implement scalable data architectures. Experience in data migration and managing large-scale data pipelines. Familiarity with DevOps practices and tools within the Azure ecosystem. Strong technical skills in SQL, Python, and R Proficiency in data modelling including reuse and scalability patterns Knowledge of Azure Monitor, Azure Security, and compliance frameworks. Ability to work with cross-functional teams and lead technical projects. Experience building data profiling, data cleansing and data engineering frameworks Address Each Selection criteria to support your application(one page summary) Essential criteria 1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description. Desirable criteria The extent to which the proposed fees represent value for money to the CER. • Wed, 05 Jun • Softtest pays pty ltd | Data Engineers » Melbourne, Melbourne Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable architecture practices for pipeline designs. Lead data migration and integration for critical change programs. Ensure data integrity and align engineering tasks with program objectives. Mentor team members and drive new data engineering practices adoption. Monitor and improve data service performance and costs. Maintain documentation and adhere to data governance policies. Research and innovate within the Azure data engineering field. Qualifications/Experience: Bachelors degree in computer science, Engineering, or a related field. Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3 years of experience in data engineering with a focus on Azure services. Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. Demonstrated ability to design and implement scalable data architectures. Experience in data migration and managing large-scale data pipelines. Familiarity with DevOps practices and tools within the Azure ecosystem. Strong technical skills in SQL, Python, and R Proficiency in data modelling including reuse and scalability patterns Knowledge of Azure Monitor, Azure Security, and compliance frameworks. Ability to work with cross-functional teams and lead technical projects. Experience building data profiling, data cleansing and data engineering frameworks. Address Each Selection criteria to support your application(one page summary) Address Each Selection criteria to support your application(one page summary) Essential criteria 1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description. Desirable criteria The extent to which the proposed fees represent value for money to the CER. • Wed, 05 Jun • Softtest pays pty ltd | Data Engineers » Perth, Perth Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline. Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable architecture practices for pipeline designs. Lead data migration and integration for critical change programs. Ensure data integrity and align engineering tasks with program objectives. Mentor team members and drive new data engineering practices adoption. Monitor and improve data service performance and costs. Maintain documentation and adhere to data governance policies. Research and innovate within the Azure data engineering field. Qualifications/Experience: Bachelors degree in computer science, Engineering, or a related field. Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3 years of experience in data engineering with a focus on Azure services. Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. Demonstrated ability to design and implement scalable data architectures. Experience in data migration and managing large-scale data pipelines. Familiarity with DevOps practices and tools within the Azure ecosystem. Strong technical skills in SQL, Python, and R Proficiency in data modelling including reuse and scalability patterns Knowledge of Azure Monitor, Azure Security, and compliance frameworks. Ability to work with cross-functional teams and lead technical projects. Experience building data profiling, data cleansing and data engineering frameworks. Address Each Selection criteria to support your application(one page summary) Address Each Selection criteria to support your application(one page summary) Essential criteria 1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description. Desirable criteria The extent to which the proposed fees represent value for money to the CER. • Wed, 05 Jun • Softtest pays pty ltd | Data Engineers » Canberra Region, Australian Capital Territory - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable architecture practices for pipeline designs. Lead data migration and integration for critical change programs. Ensure data integrity and align engineering tasks with program objectives. Mentor team members and drive new data engineering practices adoption. Monitor and improve data service performance and costs. Maintain documentation and adhere to data governance policies. Research and innovate within the Azure data engineering field. Qualifications/Experience: Bachelors degree in computer science, Engineering, or a related field. Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3 years of experience in data engineering with a focus on Azure services. Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. Demonstrated ability to design and implement scalable data architectures. Experience in data migration and managing large-scale data pipelines. Familiarity with DevOps practices and tools within the Azure ecosystem. Strong technical skills in SQL, Python, and R Proficiency in data modelling including reuse and scalability patterns Knowledge of Azure Monitor, Azure Security, and compliance frameworks. Ability to work with cross-functional teams and lead technical projects. Experience building data profiling, data cleansing and data engineering frameworks. Address Each Selection criteria to support your application(one page summary) Address Each Selection criteria to support your application(one page summary) Essential criteria 1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description. Desirable criteria The extent to which the proposed fees represent value for money to the CER. • Wed, 05 Jun • Softtest pays pty ltd | Data Engineers » Sydney, Sydney Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable architecture practices for pipeline designs. Lead data migration and integration for critical change programs. Ensure data integrity and align engineering tasks with program objectives. Mentor team members and drive new data engineering practices adoption. Monitor and improve data service performance and costs. Maintain documentation and adhere to data governance policies. Research and innovate within the Azure data engineering field. Qualifications/Experience: Bachelors degree in computer science, Engineering, or a related field. Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3 years of experience in data engineering with a focus on Azure services. Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. Demonstrated ability to design and implement scalable data architectures. Experience in data migration and managing large-scale data pipelines. Familiarity with DevOps practices and tools within the Azure ecosystem. Strong technical skills in SQL, Python, and R Proficiency in data modelling including reuse and scalability patterns Knowledge of Azure Monitor, Azure Security, and compliance frameworks. Ability to work with cross-functional teams and lead technical projects. Experience building data profiling, data cleansing and data engineering frameworks. Address Each Selection criteria to support your application(one page summary) Address Each Selection criteria to support your application(one page summary) Essential criteria 1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description. Desirable criteria The extent to which the proposed fees represent value for money to the CER. • Wed, 05 Jun • Softtest pays pty ltd | Senior Data Migration Engineer | Enterprise » Sydney, NSW - Job Description We are seeking a highly skilled Data Engineer to join the Data Migration team. The... successful candidate will be responsible for developing ETLs on Azure Synapse to facilitate the migration of data from customers... • Wed, 05 Jun • KPMG | Senior Data Migration Engineer | Enterprise » Sydney, NSW - Job Description We are seeking a highly skilled Data Engineer to join the Data Migration team. The... successful candidate will be responsible for developing ETLs on Azure Synapse to facilitate the migration of data from customers... • Tue, 04 Jun • KPMG | Data Engineer » Canberra Region, Australian Capital Territory - Job Title: Data Engineer Location: ACT or NSW Contract: 12 Months ( 12 Month Extension) Daily Rate: $1000 per day Super Talenza have partnered with a Federal Government Agency who an innovator in the utilties industry, committed to delivering high-quality solutions and services to its customers. Our client is seeking to bring on multiple Data Engineers to join their transformation office. If you are a dynamic Data Engineer and experienced with technologies within the Azure ecosystem, we would love to hear from you Role Responsibilities: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable architecture practices for pipeline designs. Lead data migration and integration for critical change programs. Ensure data integrity and align engineering tasks with program objectives. Mentor team members and drive the adoption of new data engineering practices. Monitor and improve data service performance and costs. Maintain documentation and adhere to data governance policies. Research and innovate within the Azure data engineering field. Essential Experience: Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3 years of experience in data engineering with a focus on Azure services. Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. Demonstrated ability to design and implement scalable data architectures. Experience in data migration and managing large-scale data pipelines. Familiarity with DevOps practices and tools within the Azure ecosystem. Strong technical skills in SQL, Python, and R. Proficiency in data modelling including reuse and scalability patterns. Knowledge of Azure Monitor, Azure Security, and compliance frameworks. Experience building data profiling, data cleansing, and data engineering frameworks. If you feel this opportunity matches your skills and previous experiences, please apply with your CV. Please Note: To be considered for this role you must be an Australian Citizen with a Baseline Clearance. • Tue, 04 Jun • Talenza | Senior Data Migration Engineer | Enterprise » Sydney, NSW - Job Description We are seeking a highly skilled Data Engineer to join the Data Migration team. The... successful candidate will be responsible for developing ETLs on Azure Synapse to facilitate the migration of data from customers... • Tue, 04 Jun • KPMG | Data Engineer » Canberra, ACT - Job Title: Data Engineer Location: ACT or NSW Contract: 12 Months (+ 12 Month Extension) Daily Rate: $1000... to join their transformation office. If you are a dynamic Data Engineer and experienced with technologies within the Azure ecosystem, we would love... • Tue, 04 Jun • Talenza | Data Engineer » Canberra, ACT - Data Engineer Security Clearance: Baseline Location: ACT Contract Length: Until 30 June 2025 + 1 x 12 month... extensions Close Date: Thursday 13th June 2024 - 9am Role Responsibilities and Duties Design, construct, and optimize data... • Tue, 04 Jun • Whizdom Recruitment • $208000 - 249600 per year | Staff Systems Engineer - Cloud Data Protection » Sydney, NSW - services. Your Role The Staff Systems Engineer, Data Protection, you will influence, engineer, design, build and run world... and innovative team of experts in data protection See Yourself in the Team The Storage and Data Protection crew ensure the pre... • Tue, 04 Jun • Commonwealth Bank of Australia | Data Engineer » Sydney, NSW - field. Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3+ years...Our government client are looking for several data engineers to join their team on a contract basis. Please note... • Tue, 04 Jun • Experis | Principal Data Processing Unit Software Engineer » Sydney, NSW - , Teams, OneDrive, and the Microsoft Azure platform globally with our server and data center infrastructure, security... achieve that mission. The Data Processing Unit (DPU) team brings together state-of-the-art software and hardware expertise... • Tue, 04 Jun • Microsoft | Data Engineer » Canberra, ACT - Data Engineer Location: Canberra, Sydney, Brisbane and Melbourne. Duration: 12 Months contract... a Data Engineer for our Federal government Client. This role involves providing insights, solutions, and advice to decision... • Tue, 04 Jun • DFP Recruitment | Data Center IT Support Engineer, MEL - DCO » Melbourne, VIC - Support Engineer This role is a unique opportunity to work in some of the most cutting edge data centers in the world. Amazon... region. A Data Center IT Support Engineer may be the primary point of contact for both internal customers (for example... • Tue, 04 Jun • Amazon | Data Engineers » Canberra, ACT - : Azure Data Engineer Associate. 3+ years of experience in data engineering with a focus on Azure services. Proven... and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable... • Tue, 04 Jun • Softtestpays | Data Engineers » Hobart, TAS - : Azure Data Engineer Associate. 3+ years of experience in data engineering with a focus on Azure services. Proven... and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable... • Tue, 04 Jun • Softtestpays | Data Engineers » Adelaide, SA - : Azure Data Engineer Associate. 3+ years of experience in data engineering with a focus on Azure services. Proven... and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable... • Tue, 04 Jun • Softtestpays | Data Engineers » Adelaide, SA - Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3+ years of experience in data engineering... Data Officer and the agency to create a data-driven culture that identifies external trends to inform strategic decisions... • Tue, 04 Jun • CYOS Solutions | Data Engineers » Sydney, NSW - : Azure Data Engineer Associate. 3+ years of experience in data engineering with a focus on Azure services. Proven... and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable... • Tue, 04 Jun • Softtestpays | Data Engineers » Brisbane, QLD - : Azure Data Engineer Associate. 3+ years of experience in data engineering with a focus on Azure services. Proven... and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable... • Tue, 04 Jun • Softtestpays | Data Engineers » Perth, WA - : Azure Data Engineer Associate. 3+ years of experience in data engineering with a focus on Azure services. Proven... and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable... • Tue, 04 Jun • Softtestpays | Data Engineers » Melbourne, VIC - : Azure Data Engineer Associate. 3+ years of experience in data engineering with a focus on Azure services. Proven... and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable... • Tue, 04 Jun • Softtestpays | Data Engineers » Sydney, NSW - Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3+ years of experience in data engineering... Data Officer and the agency to create a data-driven culture that identifies external trends to inform strategic decisions... • Tue, 04 Jun • CYOS Solutions | Data Engineers » Canberra, ACT - Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3+ years of experience in data engineering... Data Officer and the agency to create a data-driven culture that identifies external trends to inform strategic decisions... • Tue, 04 Jun • CYOS Solutions | Data Engineers » Darwin, NT - : Azure Data Engineer Associate. 3+ years of experience in data engineering with a focus on Azure services. Proven... and Duties: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable... • Tue, 04 Jun • Softtestpays | Data Engineers » Brisbane, QLD - Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3+ years of experience in data engineering... Data Officer and the agency to create a data-driven culture that identifies external trends to inform strategic decisions... • Tue, 04 Jun • CYOS Solutions | Data Engineers » Melbourne, VIC - Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3+ years of experience in data engineering... Data Officer and the agency to create a data-driven culture that identifies external trends to inform strategic decisions... • Tue, 04 Jun • CYOS Solutions | Data Engineer » Brisbane CBD, Brisbane - Role - Data Engineer Brisbane CBD based, Hybrid working Initial 6 months engagement , highly likely to be extended Daily rate $850/day super onwards About the role An opportunity to join the data analytics platform development team of a global company in Brisbane as a Data Engineer Responsibilities Design, build, and deploy the data lake using latest technologies Manage and scale data pipelines and analytics models Troubleshoot complex data pipeline operational issues Skills and experience Experience in Azure Data Factory, Synapse, SQL Server, Proficient in building data pipelines using Python and SQL Experience in Databricks nice to have but not mandatory Experience with Git or similar source control systems. Experience with cloud platform deployment (Azure/AWS). Excellent communication and stakeholder management skills Agile/ Scrum For more information , please contact Moitri Banerjee on 07 3291 5408 quoting reference 262602. To apply please click the 'Apply Now' button. Diversity and inclusion are strongly supported at Peoplebank. People of all nationalities, gender identities, and cultural backgrounds, including Aboriginal and Torres Strait Islander Peoples, are encouraged to apply. • Tue, 04 Jun • Peoplebank Australia Ltd | Data Engineer » Perth CBD, Perth - Data Engineer Salary: Up to £40,000 An exciting opportunity exists within our Data Engineering service for a highly skilled individual to work within our Oracle Cloud environment, which is helping to shape the future of insurance through cutting-edge data delivery to predictive analytics, data science and underwriting. The team is part of Aviva's global Data Science Practise (Quantum) and is recognised as a centre of excellence - providing an Oracle Cloud platform that delivers the data needed to drive improved decision-making and performance within Aviva. A successful candidate should be a highly motivated individual with technical knowledge including SQL, along with an understanding of insurance, an interest in analytics, good communication and stakeholder management skills, and an interest in data pipelines. A bit about the job: This is a key role within the development and maintenance of various data delivery applications, from design through to delivery and production support. You will be responsible for developing in languages including SQL, PLSQL and Python, having the necessary skills to work iteratively and liaise directly with data stakeholders. Able to deliver well-structured code to a deadline and take responsibility for the quality of the solution. Maintain and continuously improve our schedule of production data processes. Review and document the technical designs. Skills and experience we're looking for: Degree in Computer Science or equivalent numerate subject or substantial equivalent relevant industry experience. Knowledge of System Design and Application Development Lifecycle. Organised self-starter, with drive and commitment; able to work independently with little supervision. A willingness to be part of a highly collaborative team and to work closely with stakeholders in other business teams. Strong communication and presentation skills, including the ability to explain technical subject matter to non-technical audiences. What you'll get for this role: Our purpose - with you today, for a better tomorrow - is a promise we make to our colleagues too. And one of the ways we live up to that promise is by investing in you. We have so much to offer when it comes to being an Aviva colleague. Salary Up to £40,000 (depending on location, skills, experience, and qualifications) Bonus opportunity 8% of annual salary Actual amount depends on your performance and Aviva's. Generous pension scheme - Aviva will contribute up to 14%, depending on what you put in. 29 days holiday plus bank holidays, and you can choose to buy or sell up to 5 days. Make your money go further - Up to 40% discount on Aviva products, and other retailer discounts. Up to £1,200 of free Aviva shares per year through our Matching Share Plan and share in the success of Aviva with our Save As You Earn scheme. Brilliantly supportive policies including parental and carer's leave. Flexible benefits to suit you, including sustainability options such as cycle to work. Make a difference, be part of our Aviva Communities and use your 3 paid volunteering days to help others We take your wellbeing seriously with lots of support and tools. Take a look to learn more. Put a salary into this calculator to see what your total Aviva Reward could be. Aviva is for everyone: We're inclusive and welcome everyone - we want applications from people with diverse backgrounds and experiences. Excited but not sure you tick every box? Research tells us that women, particularly, feel this way. So, regardless of gender, why not apply. And if you're in a job share just apply as a pair. We flex locations, hours and working patterns to suit our customers, business, and you. Most of our people are smart working -spending around 50% of their time in our offices every week - combining the benefits of flexibility, with time together with colleagues. To find out more about working at Aviva take a look here We interview every disabled applicant who meets the minimum criteria for the job. Once you've applied, please send us an email stating that you have a disclosed disability, and we'll interview you. We'd love it if you could submit your application online. If you require an alternative method of applying, please give Sahra Abdulla a call on 07775 042 835 or send an email to sahra.abdullaaviva.com. • Tue, 04 Jun • Aviva Plc | Data Engineers with baseline security clearance » Canberra, ACT - on Azure services. · Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate... Data Engineers with baseline security clearance - Canberra · 3+ years of experience in data engineering with a focus... • Tue, 04 Jun • ZSoft Technologies | Data Engineers » Canberra Region, Australian Capital Territory - Multiple contracts - 11 12 months Must be able to obtain Baseline Security clearance No Response to criteria required Canberra Phillip with some WFH Our Client, a Federal Government Department is seeking multiple Data Engineers to join their team in July. Responsibilities: Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack. Develop scalable architecture practices for pipeline designs. Lead data migration and integration for critical change programs. Ensure data integrity and align engineering tasks with program objectives. Experience: Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate. 3 years of experience in data engineering with a focus on Azure services. Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines. Strong technical skills in SQL, Python, and R To apply for these long Data Engineers contract opportunities at Recruitment Hive please apply or call Matt on 02 6299 1006. This role closes 3pm 14/06/2024 (Job ID MF9476). • Mon, 03 Jun • Recruitment Hive | Data Engineer » Canberra, ACT - Our federal government client is recruiting for an experienced Data Engineer with strong Azure expertise to join their data... innovation and tools section. As a Data Engineer, you will be required to: Design, construct, and optimize data lakes, CI/CD... • Mon, 03 Jun • Randstad | Senior Data Engineer (Azure) » Brisbane, QLD - Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing.... Necessary Skills & Qualifications: 5+ years as a Data Engineer with Azure cloud experience. Proficiency in Azure Databricks... • Mon, 03 Jun • Randstad • $150000 per year | Data Engineers » Canberra, ACT - Data Engineer Location: ACT Contract: until 30th June 2025 Extension: 12 months Our client is seeking multiple..., or a related area. Certified in Azure Data Services, such as Microsoft Certified: Azure Data Engineer Associate. * Over 3 years... • Mon, 03 Jun • Experis | Data Engineer - AWS Cloud (Remote) » Adelaide, SA - Data Engineer (Mid/Senior) Adelaide – Fully REMOTE Work option - Anywhere within Australia Can be 06 -12 Months... Contract Overview As a Data Engineer (Mid/Senior) you will play a key role in the successful delivery of initiatives... • Mon, 03 Jun • Randstad | Data Engineer » Sydney CBD, Sydney - We are looking for a Data Engineer to join our UIP - Frontend Observability team. The Frontend Observability team is part of the UI Platform organisation. Our team’s mission is to help teams build fast experiences and make sure they stay fast. We build tools for measuring, monitoring and catching regressions in frontend performance. UI Platform delivers libraries, infrastructure and tools that power the development of fast, scalable and familiar frontend experiences across Atlassian. We are a growing team working on many impactful projects. If you are passionate about building innovative capabilities that advance the way Atlassian develops and delivers experiences, this is where the action is. We’re the team behind solutions like Performance Portal and Unified Frontend Observability . That’s where you come in. We’re looking for a data engineer familiar with data pipelines, analysis, and modeling to help our team tackle the big problems, delivering high quality data solutions. Launch new data capabilities to Atlassian developers through Performance Portal. Build tooling to empower the business to launch new data capabilities faster and easier. Collaborate with teams across Atlassian to build high quality data models for our customers. Work alongside a team of engineers, contributing to the team culture through your passion, creativity, and experience. Learn and grow as an engineer through various career development opportunities. BS in Computer Science or equivalent experience with 2 years of data engineering experience Fluency in Python SQL skills that enable advanced analysis and data modeling Experience with data pipeline tooling and warehouses, specifically DBT, AWS data services (Redshift, Athena, EMR), and Apache projects (Spark, Flink, Hive, and Kafka) Familiar with modern software development practices (Agile, TDD, CICD) applied to data engineering General familiarity with cloud environments such as AWS, Azure or GCP • Sun, 02 Jun • Atlassian | Data Engineer » Melbourne CBD, Melbourne - About the role As a Data Engineer in the Data Capability tribe you will be responsible for designing and creating data processing solutions that enable value from analytic models to drive rapid decision making. A key element of this is driving the data engineering agenda within the Data Capability Tribe, ensuring delivery of best practice end-to-end data engineering respecting ANZ architecture standards. You will challenge inefficient engineering practise in ANZ and influence change in your field to drive better business outcomes. To this end, in the role you will implement smart and relevant data engineering to drive E2E application delivery and support the uplift of data engineering capability in Data Capability, while linking in to the wider Enterprise Analytics roadmap. What will your day look like As a Data Engineer, you will be responsible for: Design data structures for data ingestion, integration and analytics layers on a variety of technologies Working in a cross skilled squad with people both from business and technology to build end to end features Contribute to design patterns for on-premise and cloud Optimise data flows by building robust, fault-tolerant data pipeline that cleans, transforms, and aggregates unorganised and messy data into databases or data sources What will you bring? MS or BS in Computer Science, Engineering, Mathematics, Statistics or equivalent practical experience in Data Engineering A strong background in data processing and software engineering and can build high quality, scalable data products Strong Software Engineering experience with proficiency in at least one high-level programming language (Python, Java, Scala) Experience and proficiency in at least one high-volume data processing environment (Teradata, Oracle, Cloudera, BigQuery or equivalent) Extensive experience working within cross-functional, agile or continuous delivery teams Strong ability to translate data insights into practical business recommendations Understand the fundamentals of distributed computing So, why join us? From the moment you join ANZ, you'll be doing meaningful work that will shape a world where people and communities thrive. But it's not just our customers who'll feel your impact. You'll feel it too. Because at ANZ, you'll have the resources, opportunities, and support you need to take the next big step in your career. We're a diverse bunch at ANZ in different roles, different locations, doing different things. That's why we have a range of flexible working arrangements, so our people can "make work, work for them". We also provide a range of benefits including access to health and wellbeing services and discounts on selected products and services from ANZ and more. At ANZ you'll be part of an organisation where the different backgrounds, perspectives and life experiences of our people are celebrated. That's because we're committed to building a workplace that reflects the diversity of the communities we serve. We welcome applications from everyone and encourage you to talk to us about any adjustments you may require to our recruitment process or the role itself. If you are a candidate with a disability or access requirement, let us know how we can provide you with additional support. Job Posting End Date 14/06/2024, 11.59pm, (Melbourne Australia) • Sun, 02 Jun • ANZ | Data Engineer » Sydney CBD, Sydney - Join a leading ecommerce brand and build critical data systems and continue to grow your GCP Engineering skillset A leading Australian eCommerce company is growing its data capability and is looking to hire a Data Engineer. As the new Data Engineer, you will be responsible for building data services that fulfil the data and reporting needs of the business as they continue to grow at scale. What You'll Do Build and deploy data pipelines written in SQL Continue to develop effective reporting solutions in Looker and GA4 Ensure that the BigQuery warehouse is maintained and data is cleansed and stored correctly Establish and maintain data best practice What You'll Bring Bachelors' degree in Computer Science or a related field Expert level SQL programming skills Strong exposure to GCP cloud services including Big Query Experience developing reporting solutions in Looker (required) and GA4 (advantageous) Excellent communication You will have the opportunity to work on projects and services critical to the business's expansion over the coming months and years. While this will be a challenging role, you will be rewarded with a leading rem package, excellent culture and a range of other benefits. Please note - we require candidates with full and unrestricted work rights, be based in Sydney and able to commute to the office 5 days a week. If you have any questions about this role or others we have available you can email Andrew directly via andrewthedrivegroup.com.au For The Latest Jobs, Tech News or to 'Introduce A Friend' for a $1000 Referral Fee - Follow Us On Linkedin: https://www.linkedin.com/company/thedrivegroup TheDriveGroup is 100% committed to improving meaningful diversity in the technology industry. We partner with clients who embrace diversity and seek candidates across all backgrounds, abilities, genders, sexualities, cultures, and faiths. If you have the right skills and attitude we would love to hear from you • Sun, 02 Jun • TheDriveGroup | Data Center Critical Facilities Engineer (Controls) » Sydney, NSW - to our core values as a company and is vital to our success. Data Center Critical Facilities Engineer (Controls) Facilities... Engineer - Controls play an integral part of ensuring optimal performance within our data centers and will be increasingly... • Sun, 02 Jun • Equinix | Senior Data Engineer » Melbourne, VIC - Senior Data Engineer Job no: 500368 Work type: Permanent - Full Time Location: Melbourne Categories: Information... Technology Internal applications are now open for the position of Senior Data Engineer based in Melbourne on a full-time basis... • Sat, 01 Jun • Alinta Energy | Senior Data Engineer » Sydney, NSW - Senior Data Engineer Sydney, Australia 6 Months (Intially) $970pd Inc Super We are seeking a highly skilled... and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer... • Fri, 31 May • Talenza | Data Engineer » Australia - , collaboration and persistence. About the Opportunity: The Data Engineer is a critical role responsible for designing, building..., and maintaining the organization's analytical data infrastructure and pipelines, ensuring the efficient and reliable flow of data... • Fri, 31 May • Adairs | Research Data Engineer » Bathurst, NSW - of both an Information Analyst and Data Engineer seamlessly. Your work in the Institute will be focussed in one of the following priority...% superannuation) You will have a strong background in data mining as well as wrangling and integrating large volumes of data... • Fri, 31 May | Data Engineer » Adelaide, Adelaide Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Essential criteria 1. Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team / section events. 2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL 3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Desirable criteria 1. Experience working with Azure Data Factory and Databricks. 2. Experience/Knowledge of working with Data Lake and Lakehouses. • Fri, 31 May • Softtest pays pty ltd | Data Engineer » Canberra Region, Australian Capital Territory - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Essential criteria 1. Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team / section events. 2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL 3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Desirable criteria 1. Experience working with Azure Data Factory and Databricks. 2. Experience/Knowledge of working with Data Lake and Lakehouses. • Fri, 31 May • Softtest pays pty ltd | Data Engineer » Brisbane, Brisbane Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Essential criteria 1. Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team / section events. 2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL 3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Desirable criteria 1. Experience working with Azure Data Factory and Databricks. 2. Experience/Knowledge of working with Data Lake and Lakehouses. • Fri, 31 May • Softtest pays pty ltd | Data Engineer » Perth, Perth Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Essential criteria 1. Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team / section events. 2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL 3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Desirable criteria 1. Experience working with Azure Data Factory and Databricks. 2. Experience/Knowledge of working with Data Lake and Lakehouses. • Fri, 31 May • Softtest pays pty ltd | Data Engineer » Darwin, Darwin Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Essential criteria 1. Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team / section events. 2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL 3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Desirable criteria 1. Experience working with Azure Data Factory and Databricks. 2. Experience/Knowledge of working with Data Lake and Lakehouses. • Fri, 31 May • Softtest pays pty ltd | Data Engineer » Hobart, Hobart Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Essential criteria 1. Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team / section events. 2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL 3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Desirable criteria 1. Experience working with Azure Data Factory and Databricks. 2. Experience/Knowledge of working with Data Lake and Lakehouses. • Fri, 31 May • Softtest pays pty ltd | Data Engineer » Melbourne, Melbourne Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Essential criteria 1. Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team / section events. 2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL 3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Desirable criteria 1. Experience working with Azure Data Factory and Databricks. 2. Experience/Knowledge of working with Data Lake and Lakehouses. • Fri, 31 May • Softtest pays pty ltd | Data Engineer » Sydney, Sydney Region - Australian Citizens residing in Australia only respond. Must be able to obtain Baseline Essential criteria 1. Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team / section events. 2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL 3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Desirable criteria 1. Experience working with Azure Data Factory and Databricks. 2. Experience/Knowledge of working with Data Lake and Lakehouses. • Fri, 31 May • Softtest pays pty ltd | Data Engineer » Queensland - . We are seeking ambitious Data Engineers to drive our expansion and innovation. About the Role: As a Data Engineer... Engineering or a Data Engineer seeking a new opportunity, apply now to join this innovative team.... • Fri, 31 May • Aurec | Research Data Engineer » Bathurst, NSW - of both an Information Analyst and Data Engineer seamlessly. Your work in the Institute will be focussed in one of the following priority...You will have a strong background in data mining as well as wrangling and integrating large volumes of data... • Fri, 31 May • Charles Sturt University | Data Engineer » Sunshine Coast Region, Queensland - Overview: Join a fast-growing investment and technology company with a 20-year track record of success. We are seeking ambitious Data Engineers to drive our expansion and innovation. About the Role: As a Data Engineer, you will develop and optimize data infrastructure, focusing on efficient pipelines and seamless data flow into predictive models. You'll work with technologies like Python, Rust, JavaScript, SQL, Prefect, AWS, Buildkite, and Docker, collaborating with a high-performing team on the Sunshine Coast. In this dynamic environment, you will tackle complex data challenges, ensuring data integrity and quality across systems. This role offers significant growth potential, allowing you to shape your responsibilities and contribute to the company's expansion and success. Key Responsibilities: Design and optimize data architecture and pipelines. Implement scalable solutions and leverage new tools. Collaborate with teams to solve complex data challenges. Ensure data integrity across systems. Key Skills/Experience Required: 3 years of experience with Python. Proficiency in SQL. 3 years in Software/Data Engineering. Experience with Rust (highly desirable). Expertise in designing, expanding, and optimizing data pipelines and data flow into predictive models. Familiarity with Prefect, AWS, Buildkite, and Docker. Experience with additional languages like JavaScript (nice to have). Why Apply: Growth Potential: Join a company at a pivotal moment of expansion. Dynamic Environment: Be part of a high-achieving, close-knit team. Professional Development: Work on challenging projects and leverage new technologies. If you're an experienced programmer transitioning to Data Engineering or a Data Engineer seeking a new opportunity, apply now to join this innovative team. • Thu, 30 May • Aurec | Data Center IT Support Engineer, MEL - DCO » Melbourne, VIC - Support Engineer This role is a unique opportunity to work in some of the most cutting edge data centers in the world. Amazon... region. A Data Center IT Support Engineer may be the primary point of contact for both internal customers (for example... • Thu, 30 May • Amazon | Data Center Technical Operations Engineer, Infraops DCEO » Sydney, NSW - DESCRIPTION The Facility Engineer with be responsible for Data Center Engineering Operations within an Amazon Data...: Sydney, NSW, AUS BASIC QUALIFICATIONS - 2+ years of electrical or mechanical, or 2+ years of data center or mission... • Thu, 30 May • Amazon | Data Engineers » Canberra Region, Australian Capital Territory - 12 12 12 months, Multiple positions Canberra CBD with some WFH, July Start Baseline Security clearance preferred Our Client, a large and well funded Government Department is looking for Data Engineers to join its Enterprise Analytics section to work across several data and analytics platforms. Experience: MS Azure StackData Integration - Data Factory, SQL Server Integration Services and or DatabricksData Store - SQL Server and or Data Lake StorageAnalytics - Azure Databricks, Azure Machine Learning, ArcGIS Enterprise Data Integration - Data Factory, SQL Server Integration Services and or Databricks Data Store - SQL Server and or Data Lake Storage Analytics - Azure Databricks, Azure Machine Learning, ArcGIS Enterprise Development tools DevOps, Visual Studio, VS Code Visualisation tools - Power BI To apply for these long Data Engineer contract opportunities at Recruitment Hive please apply or call Matt on 02 6299 1006. This role closes 3pm 06/06/2024 (Job ID MF9463). • Wed, 29 May • Recruitment Hive | Data Engineer » Baulkham Hills, The Hills District - Accucom is seeking a dynamic and experienced Solutions Consultant to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and systems for a range of clients. The ideal candidate will have a solid understanding of data architecture, data modelling, and related technologies and have experience administering and supporting complex data environments. Accucom is an established, growing business that has been operating in the education and mid-market corporate for over 36 years. We have an excellent reputation for delivering reliable customer-focused solutions and understand that it is our people who make the difference. Combined with strong vendor alliances across infrastructure, security, and cloud technologies, we leverage our strong technical skills and close customer relationships to maximise the outcome for our clients. About the role As a Data Engineer, you will design, build, and maintain: Data pipelines and ETL processes. Integrations with on-premise, private cloud, and SaaS information systems. Databases and data processing systems. Data warehouses and Business intelligence environments. Applications close no later than June 7th. Interviews will commence immediately for eligible candidates. Requirements In previous roles the successful candidate will have: Designed and built complex data systems. Developed and maintained data pipelines and ETL processes. Collaborated with cross-functional teams to troubleshoot and resolve data-related issues. Conducted data performance tuning and optimisation to enhance system speed and stability. Implemented data security measures and ensured compliance with industry regulations and best practices. Participated in data architecture and modelling discussions. Worked with clients to document business requirements and determine appropriate technical solutions. Managed multiple projects simultaneously. Further requirements include: Working with Children Clearance The legal right to work full-time in Australia • Tue, 28 May • Accucom Systems Integration Pty Ltd | Data Engineer » The Rocks, Sydney - Data Engineering with of focus on Supply Chain in the Retail Domain Join Our client team as a Data Engineer in Supply Chain Are you skilled in Python, SQL, and cloud technologies? We're looking for a talented Data Engineer to join our team and enhance our supply chain data processes. Bring your expertise to our innovative projects and help us streamline and optimize our data workflows. Core Engineering Skills NEEDED : Proficiency in Python & SQL: Essential for building and maintaining our models. Experience with Pandas, Polars, or general data engineering in Python: Required for managing our extensive Python codebase for data processing. Experience with Docker: We utilize containerized Python components extensively. Familiarity with Object-Oriented and Functional Paradigms: Our core Python code is object-oriented, while Polars code is more functional. Familiarity with Terraform: All our GCP infrastructure is managed with Terraform, requiring a cautious and conceptual approach. Proficiency in CI/CD Workflow Tools: Experience with tools like GitHub Actions, Azure Pipelines, or GCP Workflows is essential. Knowledge of Cloud Infrastructure (GCP preferred): Familiarity with GCP is preferred, but experience with AWS or Azure is transferable. Data Analytics Skills: Interpreting/Investigating Numbers: Ability to recognize patterns in numeric outputs for easier debugging and investigation. Understanding of General SQL Design Patterns: Essential for efficient data processing. Dashboard and Presentation Skills: Ability to create dashboards or presentations for stakeholders. Why Join Us? Innovative Projects: Engage in challenging projects that push the boundaries of supply chain data engineering. Supportive Culture: Be part of a collaborative team that values continuous learning and growth. Career Advancement: Opportunities to shape your career in a leading tech environment. Ready to take your data engineering skills to the next level? Apply now and become an integral part of our supply chain team HOW TO APPLY Please click on the 'Apply' button below or email your resume to kiaracorrelateresources.com • Fri, 24 May • Correlate Resources | Data Engineer » Australia - Organization: At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things. Job Title: Data Engineer Location: Bangalore-Manyata Tech Park Business & Team: Enterprise Services (ES) is responsible for the world leading application ofechnology and operations across every aspect of CommBank, from innovative product platforms for our customers to essential tools within our business. We also use technology to drive efficient and timely processing, an essential component of great customer service. The Chief Data Office is accountable for developing Group's data strategy, data policy & standards, governance and set requirements for data enablers/tools. The team is also accountable to facilitate a community of practitioners to share best practice and build data talent and capabilities. Impact & Contribution: To ensure the Group achieves sustainable competitive advantage through data & analytics, you will need to play a key role in supporting the CDO in executing to the Groups data strategy. As an Engineer, you will be required to build strong working relationships with key business and stakeholders to improve outcomes, drive engineering standards across the group, identify engineering improvement opportunities to improve our status on risk, compliance, vulnerabilities and general health of our technical solutions, while improving our E2E engineering outcomes to drive better technical outcomes across CDO. You will adopt tools and templates used across analytics systems that underpin our data and analytics capabilities for the Group. You will do this with the agility and passion of a startup; conscious that CDO supports every business unit and critical business processes across the bank, is custodian for personal and sensitive information on all of CBA's customers and its subsidiaries and interfaces with and is key dependency for hundreds of other Tier 0 and Tier 1 systems across the group Roles & Responsibilities: You will be expected to perform the following tasks and responsibilities in a manner consistent with CBA's Values and People Capabilities. Core Responsibilities- Understand our customers' core business objectives and build end-to-end data centric solutions to address them. Lead or participate in the definition, execution and communication of ETL strategy and technical solution. Development of data staging, architecture and consuming internal and external application interfaces Cooperate with business and operational users, other data management staff and infrastructure teams to ensure adherence to client and company guidelines, restrictions and requirements as well as industry standards. Participate in the full lifecycle of agile projects (ideation through implementation) Designs technical solutions and consumption patterns for business requirements with increasing complexity. Adhere to the Code of Conduct. The Code of Conduct sets the standards of behaviour, actions and decisions we expect from our people. Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks Influence and guide stakeholders to ensure that solutions are robust, secure and highly available Uplift the quality of technical solutions by applying industry best practice Role model continuous improvement mindset in team and project interactions Contributor to delivery planning, providing guidance to ensure that technical deliveries are aligned to engineering direction and strategy Risk: Operate within the CBA Group risk appetite and effectively manage strategic and operational risk related to data Adhere to the Code of Conduct. The Code of Conduct sets the standards of behavior, actions and decisions we expect from our people. Essential Skills: Mandatory experience- Minimum of 5 years of hands-on experience in Software Engineering or development using Scala or Java or python to build solution in Hadoop, Hive and Spark technologies. Minimum 5 years of hands-on experience on Teradata / Oracle / SQL Server / MySQL Minimum of 3 years of experience on Shell Scripting. Experience in designing solutions and improving the existing architecture. Deep understanding of the Big Data Ecosystem (Hadoop, Spark) Good Understanding of Distributed system and computing Must have hands on experience on Performance Tuning and Design Patterns. A good level of hands-on experience of any source control tools like GitHub, BitBucket and CI/ CD tools. Should be aware of AGILE processes and methodologies. A natural ability to effectively communicate, educate and influence the different stakeholders/ peers, to solve challenging problems, while working in collaboration with other cross-functional engineering and solution design teams A positive desire to contribute towards initiatives, along with a strong 'can- do' attitude in juggling between constantly changing priorities. Minimum 2 years of hands-on experience in Cloud Platform desirable AWS. Should have exposure all the ETL related & other services like Athena, Glue, EMR, Redshift, Aurora, S3, ECS, Lambda. (Mandatory for cloud-data Engineers and desirable for Big Data Engineers) Experience in solution design. Self-starter, autonomous working. Strong analytical skills and Strong interpersonal & communication skills. Be creative, innovative, pro-active in terms of finding solutions. Desirable experience- Prior experience on Banking Domain / Financial Services related projects would be a great value add. Hands on experience on Ab Initio is highly desirable. Exposure to JIRA/ Confluence would be beneficial. Hands on experience of Tableau, d3 and Shiny for presentation of data insights is a great value add. Good to have continuous flows development experience with Kafka streaming. Skills- Problem solving - advanced conceptual, analytical and problem-solving skills to analyze complex information for key insights and present as meaningful information to senior management. Communication - expert oral and written communication skills with ability to lead discussions with a varied stakeholder across levels. Risk Mindset -All CommBank employees are expected to proactively identify and understand, openly discuss and act on current and future risks. Qualifications: Essential: Bachelors in CS, Mathematics, Statistics or equivalent quantitative discipline or comparable industry experience Desirable: Masters in CS, Mathematics, Statistics or equivalent quantitative discipline or comparable industry experience Experience in CI/CD, Test Automation Additional industry or product certification If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We're keen to support you with the next step in your career. We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696. Advertising End Date: 19/06/2024 • Mon, 20 May • Commonwealth Bank | Data Engineer » The Rocks, Sydney - Summary: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining data systems and infrastructure. The Data Engineer will work closely with data scientists, analysts, and other stakeholders to ensure that data is properly collected, stored, and analysed to support business objectives. Responsibilities: Design, develop, and maintain data systems and infrastructure Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and design data solutions that meet those needs Develop and implement data pipelines to collect, process, and store data from various sources Ensure data quality and accuracy by implementing data validation and cleansing processes Optimise data systems for performance and scalability Troubleshoot and resolve data-related issues Stay up-to-date with emerging trends and technologies in data engineering Qualifications: Bachelor's degree in Computer Science, Information Systems, or a related field 3 years of experience in data engineering or a related field Strong programming skills in languages such as Python, Java, or Scala Experience with data modelling, database design, and SQL Experience with big data technologies such as Hadoop, Spark, or Kafka Familiarity with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform Strong problem-solving and analytical skills Excellent communication and collaboration skills • Thu, 16 May • Pope Recruitment Pty Ltd | Data Engineer » Perth CBD, Perth - The Company: Hexagon is a global leader in digital reality solutions, combining sensor, software, and autonomous technologies. We are putting data to work to boost efficiency, productivity, quality, and safety across industrial, manufacturing, infrastructure, public sector, and mobility applications. Our technologies are shaping the production and people-related ecosystems to become increasingly connected and autonomous — ensuring a scalable, sustainable future. Leica Geosystems Pty Ltd, trading as Hexagon’s Mining division solves surface and underground mine challenges with proven technologies for planning, operations, and safety. Hexagon (Nasdaq Stockholm: HEXA B) has approximately 24,000 employees in 50 countries and net sales of approximately 5.5bn USD. Learn more at hexagon.com and follow us HexagonAB. Purpose of Position: The Data Engineer is a key role for the delivery of Hexagon’s One Platform interoperable data vision. You will have a proven track record in data engineering and you will have the opportunity to change an industry – to enable that industry to improve how it works with data across it’s entire value chain. The Data Engineer responsibilities are; Champion best-practice and drive adoption of Hexagon’s data standards. Ensure data definitions are clearly defined and easy to consume. Enable the delivery of data-interoperability across the entire mining industry value-chain. Train software development and data science teams on application of the data standards. Review new data definitions against data standards and advise required changes. Ensure data definition classification, definition overlap and versioning is managed. Identify and assist in defining new high-value data definitions for data science applications Work with BI report developers to identify gaps or improvements to data definitions. Responsibilities: Strong time management and prioritisation skills. Strong communication and interpersonal skills. High level of personal drive and self-motivation. Desire to expand own knowledge and skill set as well as share knowledge. Review, validate and contribute to technical documentation relating to the deployment of new data definition releases. Communicate progress status of work. Provide accurate estimates of remaining work. Compliance with Hexagon’s Workplace Health and Safety policies and procedures, participation in audits and compliance with instructions given in respect to the health and safety of himself / herself and the safety of others. Other duties as required from time to time. Required Experience: Understanding of the principles, tools and programs required for data Experience engineering, reporting, analytics, visualisation and/or machine learning. Experience analysing data and with data engineering projects. Experience in writing and maintaining technology and data documentation. Understanding of Mining environment Desired Experience: Experience working with data standards that have been defined. Experience conducting data analysis and preparing reports. Experience working with data pipelines. Experience with data lakes and data lake tools Experience with coding such as SQL, NoSQL, Python. Experience with relational and non-relational databases. • Wed, 15 May • Hexagon Mining, Inc. | Data Engineer » Sydney, Sydney Region - Data Engineer Sydney $170,000 Inc Super Bonus As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment. Key Responsibilities: Utilize your expertise in data warehousing and information management to contribute to the development of our future-ready Data Platform. Design and implement data models to support business requirements. Leverage your Linux/Unix skills and prior experience with AWS to build robust and scalable data solutions. Develop and optimize complex SQL queries and data manipulation processes. Utilize Big Data querying tools such as Hive, Spark, and Presto to extract insights from large datasets. Implement API-based integrations and orchestrate data pipelines using tools like Apache Oozie, Airflow, or Argo Workflows. Apply your knowledge of technical solutions, design patterns, and code to develop medium/complex applications deployed in clustered computing environments. Desired Skills and Experience: Proficiency in programming languages such as Scala, Java, or Python, particularly in the context of Big Data technologies like Spark. Redshift. Experience working with Docker, Kubernetes, and familiarity with containerized environments. Exposure to security concepts and best practices related to data engineering. Knowledge of machine learning concepts and tools such as Spark ML or R. Experience with major Hadoop distributions such as Cloudera, MapR, or Hortonworks HDP. Familiarity with build tools like Maven, Gradle, and Ant. If you feel you possess the relevant skills to the above, apply now with most updated CV • Tue, 14 May • Talenza | Data Engineer » Brisbane CBD, Brisbane - Our client is seeking an experienced Data Engineer to join a dynamic Data Team. As a Data Engineer, you will play a critical role in designing and maintaining the data architecture, ensuring data quality and actionable insights. If you have experience in data engineering and a passion for leveraging data to drive business value, we want to hear from you. Our client is a growing organisation based in Brisbane CBD, dedicated to establishing and managing community initiatives. Their Data Engineer role will allow the successful candidate the following: Opportunity to be a key senior member of a dynamic the Data Team working with Snowflake; Responsibility for data architecture & modelling, ensuring data quality and actionable insights; and Work with cutting-edge technologies and drive business value through data engineering. Responsibilities and Accountabilities: Design, build and maintain Snowflake data warehouse, ensuring scalability and performance; Organise and analyse raw data from different sources; Maintain documentation of data architecture and data warehouse data models; Project manage tasks and larger workstreams, ensuring successful outcomes; Develop, test, deploy and automate ETL/ELT solutions using Azure, SQL, REST API connectors and Azure Data Factory (ADF); Gather and process raw data at scale, including scripting, API invocation and SQL query development; Partner with Corporate Services to implement best practices for data quality assurance, data governance and data security; Troubleshoot production issues and interpret trends and patterns in the data for actionable insights; Partner with business stakeholders to understand use case requirements and identify opportunities to deliver business value; and Evaluate emerging technologies and industry trends in data engineering. Salary: Competitive, commensurate with experience. Location: Brisbane CBD, Queensland If you're ready to take on a challenging role in data engineering and make a positive impact, apply now. Please submit your CV and covering letter detailing your relevant experience and interest in the position. How to Apply For more information or a confidential discussion please email Tyler Dewar at u&u on tyler.dewaruandu.com quoting reference number 36377. At u&u Recruitment Partners, we value diversity, equity and inclusion. We welcome applications from Aboriginal and Torres Strait Islander people, people with diverse cultural and linguistic backgrounds and people with disability. Should you require reasonable adjustments throughout the recruitment process, we encourage you to make a request via adjustmentsuandu.com or phone the above-mentioned u&u consultant to discuss. In response to these requests, we will collaborate closely with you to implement the appropriate adjustments. Additionally, for a barrier-free and inclusive online experience, you can access u&u's opportunities using accessibility software Recite Me at https://www.uandu.com/jobs. Please submit your resume in Word format only. • Tue, 14 May • u&u | Data Engineer » North Sydney Area, North Shore - Job Description Nine is hiring a Data Engineer to join its Data team to continue to make data a competitive advantage. As a Data Engineer, you will work with key stakeholders to build high-performing data products and reduce the complexity in our data systems and data models. You will partner with our Product function to enable the use of data to create innovative solutions for our business, focusing in the data commercialization space. Responsibilites Designing and implementing data pipelines and data processing frameworks at petabyte scale in Google Cloud, Apache Airflow, DBT, BigQuery and other cutting edge tools. Craft solutions that directly enable reporting specialists, analysts and super-users by exposing consumption focused dimensional data models and data products / visualisations. Work across the Data Engineering teams, Vendors and Business Stakeholders to contribute to the continuous improvement of data products, processes and systems. Provide data on industry trends, emerging technologies, and new tool sets - we aren't afraid to experiment Keep up to date with media and technology industry changes and stimulate discussion. Ensure deliveries are up to date with the latest technologies. • Tue, 14 May • Nine | Data Engineer » Largs North, Port Adelaide Area - Nurture. Grow. Thrive. Accepting a role with Elders means you will be joining a team ready to support and grow your career. Be part of a culture that has been in the making for more than 185 years, a culture so strong it is almost tangible. Much like the farmers and communities we work with, you will experience, passion, dedication and resilience across all parts of the business. With such an iconic, essential business in the Australian landscape we are confident that you too will be proud to grow your career at Elders and wear the pink shirt. About the role We are looking for an experienced Data Engineer to join the Elders team on a permanent, full-time basis. The Data Engineer will work with a variety of business stakeholders to deliver appropriate, value driven dynamic insights and data applications to the business, providing high value knowledge for Elders business today and into the future. Strong technical knowledge of data platform technologies is critical, requiring experience with a variety of technology and platforms. Demonstrated experience with analytics models and labs, Power BI, Microsoft Azure, Data Factory, Databricks, Python and Azure DevOps CI/CD pipelines is essential for this role. Responsibilities Design, develop and ensure data pipeline and data linage for all data ingested into the data platform Maintain existing data pipelines Design and implement data models per business requirements Identify opportunities for new data acquisition Develop data transformation tasks to combine raw data from different sources into business consumable datasets Provide input to project planning and estimations Assist with BAU support as required About you Tertiary qualification in a relevant discipline (such as Business, IT, Engineering, Accounting) or significant equivalent workplace experience. Experience developing or working with architectural concepts, strategies, roadmaps, reference architectures, architectural patterns, frameworks and principles. Strong knowledge, qualifications and experience in Big Data architecture i.e. Snowflake, Azure Data Factory, Databricks, Power BI. Strong programming and data transformation experience (SQL, Python) Experience with the Microsoft Azure Cloud Infrastructure Experience in CI/CD pipelines and DevOps practices and tools. Experience in supporting all aspects of the SDLC process including business requirement analysis, designing, performance dimensioning, developing, UAT, deploying and providing support. Solid general IT experience (applications, on premise and cloud infrastructure) including systemic knowledge of IT development, operational and change management processes and methodologies. Experience in an agile delivery environment About Elders Elders is proud to be the last Australian-listed major agribusiness. The most trusted agribusiness brand in Australia. We're part of the landscape, part of the local communities, part of Australia's history and we are entrenched in Australian agriculture. The brand is more than a company, more than a logo - it's part of Australia. And, with an authentic drive to create a sustainable future for farming and the farmers of Australia, Elders is for Australian agriculture. We are now looking for the next generation to be part of something big and drive the future of Elders. If you are ready to grow your career with Elders, please click on 'Apply' today. For more information call Heath Greenham on 0439 924 836 or visit our careers page Please note, applications may be shortlisted as they are received. At Elders, we strive to create a safe environment where everyone can thrive. We aspire to do this by recognising talent, promoting inclusion and celebrating diversity. No matter how you identify, we encourage talented people from all backgrounds, abilities and identities to apply for roles at Elders. We will accept applications from all people with the right to live and work in Australia. LI • Fri, 10 May • Elders | Related Jobs in Australia | |
---|
|