News Aggregator

ETL, ELT, and Reverse ETL

Aggregated on: 2022-05-22 04:35:57

This is an article from DZone's 2022 Data Pipelines Trend Report.For more: Read the Report ETL (extract, transform, load) has been a standard approach to data integration for many years. But the rise of cloud computing and the need to integrate self-service data has led to the development of new methodologies such as ELT (extract, load, transform) and reverse ETL.

Applying Kappa Architecture to Make Data Available Where It Matters

Aggregated on: 2022-05-21 21:05:57

Introduction Banks are accelerating their modernization effort to rapidly develop and deliver top-notch digital experiences for their customers. To achieve the best possible customer experience, decisions need to be made at the edge where customers interact. It is critical to access associated data to make decisions. Traversing the bank’s back-end systems, such as mainframes, from the digital experience layer is not an option if the goal is to provide the customers the best digital experience. Therefore, for making decisions fast without much latency, associated data should be available closer to the customer experience layer. Thankfully, over the last few years, the data processing architecture has evolved from ETL-centric data processing to real-time or near real-time streaming data processing architecture. Such patterns as change data capture (CDC) and command query responsibility segregation (CQRS) have evolved with architecture styles like Lambda and Kappa. While both architecture styles have been extensively used to bring data to the edge and process, over a period of time data architects and designers have adopted Kappa architecture over Lambda architecture for real-time processing of data. Combining the architecture style with advancements in event streaming, Kappa architecture is gaining traction in consumer-centric industries. This has greatly helped them to improve customer experience, and, especially for large banks, it is helping them to remain competitive with FinTech, which has already aggressively adopted event-driven data streaming architecture to drive their digital (only) experience.

Instancio: Test Data Generator for Java (Part 2)

Aggregated on: 2022-05-21 16:05:57

In part 1, we introduced Instancio and how it can be used to automate data setup in unit tests. To recap, Instancio is a library that automates data setup in unit tests, with the goal of reducing manual data setup. More specifically, it accepts a class (or a "type token") as an argument and returns a fully-populated instance of the class. Sticking to our Person class for all our examples, this can be done as follows: Java person = Instancio.create(new TypeToken>() {});" data-lang="text/x-java"> Person person = Instancio.create(Person.class); Map<UUID, Person> person = Instancio.create(new TypeToken<Map<UUID, Person>>() {});

Challenges to Designing Data Pipelines at Scale

Aggregated on: 2022-05-21 13:35:57

This is an article from DZone's 2022 Data Pipelines Trend Report.For more: Read the Report The current challenge in the world of data is no longer in the processing capacity of volumes of data. Because of the performance of modern current streaming platforms and owing to a new generation of data repositories that allow decoupling computation from the storage layer, we can improve scalability with very low operational effort.

An Overview of Key Components of a Data Pipeline

Aggregated on: 2022-05-21 02:35:56

This is an article from DZone's 2022 Data Pipelines Trend Report.For more: Read the Report With the consistent growth of data-driven applications, the complexities of consolidating data from multiple sources for streamlined decision making is often considered a key challenge. While data forms the foundation of analytics and operational efficiency, processing big data requires holistic data-driven strategies for real-time ingestion and processing. To help with this, data pipelines enable organizations to aggregate and analyze huge datasets by defining a series of activities that convert raw data into actionable insights.

4 Things Developers Should Know About Recruiting Neurodiverse People

Aggregated on: 2022-05-21 01:35:56

We want to make the Dev Interrupted podcast a vital, enjoyable part of your week. Please take 2 minutes and answer our new Listener Survey. It lets us know a bit about you, what you want from Dev Interrupted and what you want from podcasts in general! This article was written exclusively for Dev Interrupted by Lewis Dowling

June 1-3 Open Source RT-Thread IoT OS Global Tech Conference

Aggregated on: 2022-05-20 16:50:56

The 2021 RT-Thread IoT OS Tech Conference has 1500+ developers registered for the conference, over 20 topics were shared, featured on the open-source RT-Thread OS projects and the new development RT-Smart Micro-Kernel OS, RISC-V ecosystems and associated manufacturers introduced, STM32 ecosystems, embedded projects showcase, IoT security, trending technical knowledge such as AI, ROS, Rust, Micropython, and more! The 2022 RT-Thread IoT OS Global Tech Conference will continue kicking off with unique insights, exciting innovative technologies, inspiring projects showcases.

What Is Cloud-Native Architecture?

Aggregated on: 2022-05-20 15:50:56

Today, every IT resource or product is offered as a service. As such, cloud-native software development becomes a key requirement for every business, regardless of its size and nature. Before jumping onto the cloud bandwagon, it is important to understand what cloud-native architecture is and how to design the right architecture for your cloud-native app needs. Cloud-native architecture is an innovative software development approach specially designed to leverage the cloud computing model fully. It enables organizations to build applications as loosely coupled services using microservices architecture and run them on dynamically orchestrated platforms. As a result, applications built on the cloud-native application architecture are reliable, deliver scale and performance, and offer faster time to market.

Debugging Java Collections Framework Issues in Production

Aggregated on: 2022-05-20 15:50:56

The Java Collections Framework was a huge leap forward when it was introduced as part of Java 2 (JDK 1.2). Thanks to the included collection classes we finally moved beyond the limits of Vector and Hashtable to more mature and generic solutions. With the introduction of Streams and functional concepts in Java 8, the framework took everything to the next level. One of the core principles underlying the framework is coding to the interface. As such, you would use the List interface or a Collection interface instead of the concrete implementation. This is great engineering but it makes debugging the Java Collections far more challenging.

Aggregate Functions in Stargate’s GraphQL API

Aggregated on: 2022-05-20 15:20:56

A new release of Stargate.io was applied to Astra DB that includes an exciting new feature: aggregate functions! If you’re not familiar with aggregate functions, they are functions that look at the data as a whole and perform a function like min(), max(), sum(), count() and avg(). Until now, aggregate functions were only available using cqlsh (the CQL Shell). However, with the Stargate 1.0.25 release they are now also available using the GraphQL API. In this blog entry, I’ll walk you through the process to get early access to this exciting new functionality in Stargate, and how to setup everything you need to test your own aggregate queries.

Creating Event-Based Architecture on Top of Existing API Ecosystem

Aggregated on: 2022-05-20 14:50:56

We are all creatures of convenience. So just think, which package delivery company you would give a favorable review: the one that, though providing package tracking, informs you on what day and within what time frame you’re supposed to expect your delivery to arrive (and even that ends up incorrect due to, say, traffic delays), or the one that actively notifies you that your package is now ‘this many’ stops away from you? The demand for real-time applications and services is undoubtedly increasing. If your business app or service is customer-oriented, be aware that customers will probably expect a more immediate, real-time experience. And with that, the topic of event-driven architecture increasingly gains strategic importance and hence the interest from companies of all sizes.

Taking Your App Offline with the Salesforce Mobile SDK

Aggregated on: 2022-05-20 13:05:56

Last year, my wife and I gained the first-time experience of building a brand-new home. The process was fun and exciting, but we also experienced the unexpected internet service interruptions that often accompany new home subdivisions. While these outages impacted my family’s ability to stream services, such as Amazon Prime, Hulu, and Netflix, I continued working on my current project, due to the intentional design of being able to work in an isolated (or offline) state. This has always been helpful during airline travel when I work from Nevada and Florida during the year.

7 Traits of an Effective Software Asset Manager

Aggregated on: 2022-05-20 11:50:56

The global software asset management industry is expected to grow to a staggering $4.27 billion by 2027. With the growing complexity of software ecosystems, there has never been a better time for reinvention and changing the way companies manage their software portfolio to ensure improved quality. What Is SAM and Why Are Companies Interested in It? Software asset management (SAM) is a process within the more holistic IT asset management services. It involves managing procurement, implementation, utilization, and maintenance of software across a business. That’s the gist of it and something you would find in Google snippets regarding SAM.

Implementing RBAC Configuration for Kubernetes Applications

Aggregated on: 2022-05-19 22:50:56

Security is challenging to implement, and when your infrastructure is made up of many dynamic, scalable, distributed microservices running in containers, the task becomes even more complex. Kubernetes is an open-source container orchestration technology that may be used to automate software applications' deployment, scaling, and administration. We commonly refer to these levels as the 4Cs because they are formed of distinct layers (cloud, clusters, containers, and code).

Which JVM Version Is the Fastest?

Aggregated on: 2022-05-19 22:05:56

Benchmarks This article will use open-source Chronicle Queue to exchange 256-byte messages between two threads whereby all messages are also stored in shared memory (/dev/shm is used to minimize the impact of the disk subsystem). Chronicle Queue is a persisted low-latency Java messaging framework for high-performance and critical applications. Because Chronicle Queue is operating on mapped native memory, it eliminates the need for garbage collections giving developers deterministic high performance.

Geographic Scale With Virtual Machines and Kubernetes Nodes

Aggregated on: 2022-05-19 21:05:56

In my last post, we looked at how we can deploy CockroachDB across multiple regions in Azure with the help of Cilium CNI. In this post, we evolve this architecture to allow for the use of a mix of Kubernetes pods and virtual machines. Because CockroachDB is a single binary it makes it easy to deploy as a container or just run it natively on virtual machines. This type of architecture may be required for a number of reasons. As businesses consider their future cloud strategy and how they can move their existing applications workloads to the Public Cloud, this type of hybrid architecture may be required. Perhaps the on-premises data centers do not have the capability to run a Kubernetes environment as this can be complex and requires additional infrastructure that may not be available. This is just one example but there are likely to be many. Now let's take a closer look at the deployment details.

Securing Containers With Seccomp

Aggregated on: 2022-05-19 20:05:56

This blog post is the second half of my research on making it easier to create Seccomp-BPF filters and secure your containers with them. If you haven’t read the first half of this blog post yet, I recommend doing so before continuing here. For returning readers, I’ll briefly refresh you on my last post. I introduced Seccomp-BPF, which is a Linux kernel feature that allows you to create filters that restrict which syscalls a process can make. This allows you to prevent a process from being able to do something that it was not intended to do if it requires a new syscall. Seccomp-BPF filters can also be applied to container runtimes and orchestration tools to limit what your containers can do while they’re running. That allows you to add a layer of protection against the potential exploitation of your applications and services.

Apache Kafka Essentials

Aggregated on: 2022-05-19 20:05:56

Dive into Apache Kafka: Readers will review its history and fundamental components — Pub/Sub, Kafka Connect, and Kafka Streams. Key concepts in these areas are supplemented with detailed code examples that demonstrate producing and consuming data, using connectors for easy data streaming and transformation, performing common operations in KStreams, and more.

Event Meshes and Multi-Cloud

Aggregated on: 2022-05-19 20:05:56

Digital transformation is leading to the accelerated adoption of cloud-native applications. These applications typically use a microservices-style architecture that span across multiple zones to provide for scalability. Most cloud-native applications even span across multiple cloud providers in order to complete complex business processes such as banking, logistics, and telehealth. Such a complex business process requires orchestration among multiple microservices (sometimes in hundreds), multi zones, multi-cloud providers, and multiple data centers. The event-driven architecture (EDA) style is central to orchestrated execution of business processes that are compartmentalized by business contexts and implemented through microservices. The EDA also plays a key role around data in the cloud-native space, which is bounded to microservices, and will need to be managed as different segments of transactions are processed across multiple microservices.

Create a Self-Service Customer Support Chatbot Without Code

Aggregated on: 2022-05-19 19:05:56

Helping users help themselves is one of the biggest wins a customer support team can achieve. When this happens, support has fewer tickets, and users can get their answers quickly. In fact, a study by American Express found that over 60% of consumers indicate their “go-to channel” for simple inquiries is a digital self-service solution (online chat, voice response, website, or mobile app). With that in mind, chatbots are an ideal tool to provide self-service at scale. However, building a chatbot can be intimidating for the uninitiated. That’s a problem that Infobip’s Answers platform seeks to solve. With Answers, you can create intelligent, keyword-based chatbots that can improve customer satisfaction and reduce operational costs directly—and you can build that all with a no-code web GUI.

Why Your Digital Transformation Strategy Must Include Continuous Testing?

Aggregated on: 2022-05-19 19:05:56

Traditional approaches to enterprise IT – typically reliant on time-consuming, manual processes – have been overtaken in recent years by more agile, efficient, outcome-orientated models. And with that shift putting an emphasis on faster cycles of development for software products, DevOps and Agile methodologies are now essential for any business looking to succeed with a meaningful digital transformation initiative.

Develop Multi-Value Applications With Modern Source Code Managers

Aggregated on: 2022-05-19 18:05:56

Legacy Version Control Tools for Multi-Value Application Development The legacy version control tools are specific to the multi-value programming controls BP libraries and DICT files on the PICK operating system environment. Checking out code from a BP Library is usually known as the locking process because files get locked by the developer for the time of their code change request. This leads to the sequencing of processing code change requests because the files that the developer intends to modify are locked and copied to the development stage. Let’s use an example to well explain this concept. Let’s consider five staging levels, such as development, QA, UAT, pre-production, and production environments. The developer is required to move their code changes through these staging environments. The developer checks out the elements from the production BP library to the development BP library and begins to work on modifying the elements.

How to Utilize Python Machine Learning Models

Aggregated on: 2022-05-19 18:05:56

Ever trained a new model and just wanted to use it through an API straight away? Sometimes you don't want to bother writing Flask code or containerizing your model and running it in Docker. If that sounds like you, you definitely want to check out MLServer. It's a Python-based inference server that recently went GA, and what's really neat about it is that it's a highly-performant server designed for production environments. That means that, by serving models locally, you are running in the exact same environment as they will be in when they get to production. This blog walks you through how to use MLServer by using a couple of image models as examples.

Setup for Success: Creating Web3 Projects With the Truffle for VS Code Extension

Aggregated on: 2022-05-19 17:35:56

Introduction Working with any new technology can be both an exciting and scary experience. On one hand, you might feel excited about building with a new set of tools. But knowing how to choose the right ones, amongst all the tools available, can also be overwhelming. Whether you're just starting to learn Web3 or are an experienced builder, you will understand this daunting experience well. Developers need to have knowledge not only of Web3-specific concepts like blockchains and smart contracts but also of an entirely new tool stack to develop on these concepts. However, with the right steps and proper tools, developers can build on Web3 technologies relatively quickly and efficiently.

Types of UI Design Patterns Depending on Your Idea

Aggregated on: 2022-05-19 17:05:56

Nowadays, UI and UX design are essential for almost every business. Without these technologies, every device or software usage would be unattractive or even impossible. But what are they, and why are they important? UI vs. UX What Is the Difference? First of all, why could they be met together? All of us at least once saw the UI/UX phrase. They are two parts of one process. UI stands for User Interface, while UX is user experience. The combination of the UI and UX provides the best final result. To understand why we should take a look at both of them separately.

After Inspection, Comes Adaptation: How to Do Action-Based Retrospectives Right

Aggregated on: 2022-05-19 16:35:55

“At regular intervals, the team reflects on how to become more effective, then tunes and adjusts its behavior accordingly” — Agile Manifesto Self-reflection within teams is fundamental to enabling Agile ways of working. Let’s take the most common Agile methodology, Scrum. This framework prescribes five events, one of which is the retrospective.

GraphQL Essentials

Aggregated on: 2022-05-19 16:35:55

As an alternative to REST, GraphQL is quickly gaining popularity as a tool for building APIs and fetching declarative data. This Refcard introduces GraphQL concepts such as core design principles, schemas and types, fields, arguments, and lastly, how to secure your GraphQL APIs.

Privacy and the 7 Laws of Identity

Aggregated on: 2022-05-19 15:50:56

In 2005, the late Kim Cameron penned “The Laws of Identity.” The paper explored how to give internet users a deep sense of safety, privacy, and certainty about their interactions online. With the proliferation of web-based services and applications, it was essential to develop a formal understanding of the dynamics causing digital identity systems to succeed or fail. Nearly 20 years later, Cameron’s seven laws of identity are still applicable today. Published shortly after the dot-com bust and the introduction of social media, this paper came at a point of inflection for the Internet. Today, with the promise of Web3, a metaverse, and adjusting to a largely virtual working world, we’re living through a similar shift in history. For both points in time, digital identity is at the epicenter—and it’s worth remembering some tried and true lessons from the past.

Getting Started With Events in Svelte

Aggregated on: 2022-05-19 15:50:56

Events in Svelte are quite intuitive and easy to use. In this guide, we'll look at how to get started with Svelte events. It is assumed you have a good understanding of Javascript for this guide. If you are brand new to Svelte, it might make sense to read my guide on creating your first Svelte application before beginning. Events in Svelte When we create new components in Svelte, we will usually want them to do certain things when users interact with them - for example, hover over them or click on them. Svelte allows for all the events you'd typically find in vanilla Javascript. For more on Javascript events, click here.

Raft or Not? The Best Solution to Data Consistency in Cloud-native Databases

Aggregated on: 2022-05-19 15:50:56

Consensus-based replication is a widely-adopted strategy in many cloud-native, distributed databases. However, it has certain shortcomings and is not the silver bullet. This post aims first to explain the concepts of replication, consistency, and consensus in a cloud-native and distributed database, then clarify why consensus-based algorithms like Paxos and Raft are not the silver bullet, and finally propose a solution to consensus-based replication.

Enough Already With ‘Event Streaming’

Aggregated on: 2022-05-18 23:50:55

Anyone watching the current (streaming?) video series of the 2022 EDA Summit is likely to once again be shocked by the number of EDA thought leaders making interminable references to event streaming. Why shocked? Because events are NEVER "streamed," and anyone claiming to understand EDA probably ought to understand that fairly fundamental point. The Oxford Dictionary defines "streaming" as "a method of transmitting or receiving data (especially video and audio material) … as a steady, continuous flow, allowing playback to start while the rest of the data is still being received." Events, you are probably aware, are never split across separate payloads. Indeed, on major platforms such as AWS where event payloads are limited to a maximum of 256 KB, even then I have never seen an individual event payload that came close to exceeding this limit.

AccuRev Uses Rally and Anthill Pro in New Tool Suite

Aggregated on: 2022-05-18 23:35:55

As agile is adopted by more development shops, the demand for integrated tools that cover the whole application development lifecycle is increasing. Some agile tool vendors try to create the entire suite by themselves, like IBM. Others will try to bring together popular, battle-tested tools from several different sources and combine them into one offering. That's what AccuRev has done. They recently announced their new offering, AgileCycle, which combines Rally Software and Urbancode's Anthill Pro with AccuRev SCM software. At its core, AgileCycle uses AccuRev Enterprise edition, which includes software configuration management and AccuWork's defect and issue tracking with workflow. Rally's Enterprise project management software is included in the package along with Urbancode’s AnthillPro. Rally takes care of story requirements for agile development, while Anthill Pro handles continuous integration along with build and release management. One area that AccuRev wanted to keep agnostic was testing. AgileCycle has a plugin architecture to integrate a customer's preferred third-party testing tools.

The Engineer’s Guide to Creating a Technical Debt Proposal

Aggregated on: 2022-05-18 23:35:55

This article will guide you through the process to craft a technical debt proposal to justify the time spent solving technical issues. Technical debt is a slow killer of an engineering team’s productivity. At first, technical debt might not seem to be a blocker, but it can hinder your team’s efficiency as time progresses.

Useful Links for Azure Users

Aggregated on: 2022-05-18 23:35:55

It’s been a busy week here for Brian and I, lots of stuff going on. We did have time to collect some links however, which I share with you now. Enjoy! 8 Essential Best Practices in Windows Azure Blog Storage: “Throughout this article I’ll discuss 8 essential best practices to support you in maintaining and controlling both cost and availability. In this article I’ll look only at the best practices for the Public Containers inside Blob Storage and in future articles we’ll talk about the other types of storage.” How to Choose Between Windows Azure Queues, Windows Azure Service Bus Queues: “The article helps you compare and contrast the respective technologies and be able to make a more informed decision about which solution best meets your needs.” Why is Windows Azure Deployment Slow Compared to Heroku?: This is a balanced look at Azure and Heroku that offers great insight into why deployment times differ. So what does “The Cloud” mean now?: A humorous, but still serious, look at what “The Cloud” means to different people. Beta of Window Phone Toolkit for Amazon Web Services released: This move, IMHO, speaks volumes about Microsoft’s commitment to interoperability. Hosting your Moodle on Windows Azure: A short post highlighting 2 projects that allow you to hose Moodle on Azure. Architecting for Failure: Why Cloud Architecture is Different (Meetup): If you are in the Boston area on Feb. 7th, this looks like it would be a good Meetup to attend. NougakuDoCompanion: A “Ruby on Rails” companion for Windows Azure: A short post that highlights a project that makes hosting RoR apps on Azure easy. Handling two known issues with Windows Azure node.js SDK 0.5.2: Workarounds for an exception while testing your node.js app in the Compute Emulator and for troubles with publishing a MongoDB-enabled node.js app to Azure. A chat with Nick Quaranto about rubygems.org internals: Q&A about what goes on inside RubyGems.org to make the magic happen. Prompts and Directories - Even Better Git (and Mercurial) with PowerShell: Scott Hanselman talks about using PowerShell to work with Git and Mercurial. The client-side templating throwdown: mustache, handlebars, dust.js, and more: There’s a ton of templating solutions out there, Veena Basavaraj discusses how LinkedIn picked dust.js as it’s client-side templating solution. Beautiful docs: A collection of well-written documentation to serve as examples to those of us who write docs. Backbone.js: A Roundup for Beginners: A collection of links useful for learning how to work with Backbone.js. Source: http://blogs.msdn.com/b/silverlining/archive/2012/02/03/pie-in-the-sky-february-3rd-2012.aspx

This Is How You Give Good Feedback at Work

Aggregated on: 2022-05-18 23:05:55

Good feedback is all about the little moments. I have written before that the most important trait in a new hire is coachability. What a shame it would be if you went out and hired an extremely coachable talent, and then failed to effectively coach. No doubt, there is skill involved in giving effective and meaningful feedback. Here are my rules of thumb, which will hopefully make it easier:

Everything You Need To Know About Page Object Model and Page Factory in Selenium

Aggregated on: 2022-05-18 22:05:55

As we continue to automate the test cases on a daily basis using Selenium automation, the maintenance of the growing test suite parallelly becomes complicated. While automating the test cases on Selenium, there would be an instance where we use the same web element in multiple test scripts. For example, while automating an E-Commerce application, in every test case we have to search for a particular item from a search field using Selenium locator i.e. using XPath or ID. For such scenarios, we add the search field locator in every test script which would eventually increase code duplication. Moreover, if there is any change in the locator, we have to change the locator in every test script where a particular web element is used. To overcome such challenges, we would be further looking at the Page Object Model that would help build a framework that is easy to use and maintain.

What Is Lean Software Development

Aggregated on: 2022-05-18 20:50:55

Lean software development (LSD) is an agile framework or a set of principles and practices that emphasize delivery value and reduce software development waste. LSD limits queues and helps to eliminate unnecessary stages in the workflow. It focuses on improving quality, amplifying learning, and continuously improving by optimizing time and resources. A Brief History of Lean LSD originates from the manufacturing movement. It was implemented by Toyota Production System to eliminate the non-efficient use of time and resources. Back then, the term "lean" was suggested as well. Gradually, different manufacturing organizations have started implementing this approach in their industries. In 2003, lean software development appeared. It was first mentioned in relation to software creation in the world-known book by the same name written by Mary and Tom Poppendieck.

How to Give Props Default Values in Vue

Aggregated on: 2022-05-18 20:20:55

When we use components in Vue, we often use properties or props to pass custom pieces of data down to the child component. For example, we can tell our child component that for this version of the component, "name" is set to "my-component": Vue.js Component " data-lang="script/x-vue"> <Component name="my-component" /> If we try to call this component without a name prop, it returns undefined in the code, or just as no text when rendered in HTML. Let's say our Component looks like this:

Build a Seamless GitOps Pipeline with Flux

Aggregated on: 2022-05-18 19:50:55

GitOps is a set of principles for you to implement continuous deployment for cloud-native applications using Git as a single source of truth. With GitOps, you treat everything, including infrastructure, as source code and store it in Git. GitOps lets you automatically deploy code as soon as it is committed to a Git repository. Here are some of its benefits: It offers a developer-centric approach It promises high reliability with faster error recovery It gives you complete visibility It greatly increases your productivity When adopting GitOps in any organization, it takes setting up a GitOps that is different from a more traditional CI/CD pipeline. Modern cloud-native tools make up this new pipeline. In this post, we list the most vital tools that make up a GitOps pipeline. We also discuss the practices that go along with these tools, which are sometimes more important than the tool itself. The list is not meant to be exhaustive but is a good indicator of the leading GitOps tools today.

Cybersecurity Threats of EV Charging Stations

Aggregated on: 2022-05-18 18:20:55

According to Statista, In January 2022, there were almost 113,600 charging stations for electric vehicles in the United States. California has a large number of these charging stations, with nearly 41,300 public and private power outlets. As the number of electric vehicles (EVs) on the road continues to grow, so does the need for public and private EV charging stations. While most EV owners charge their cars at home or work, there are still many times when they need to rely on public charging stations.

Develop a Sense of Code

Aggregated on: 2022-05-18 18:20:55

The more the counter next to my years-in-tech metric increments upward, the more I find myself in situations where I talk about career paths, skill decisions, and choices about specializations. It might be talking to a publication, on a panel, or one-on-one with someone who wants to get into or ahead in IT. One of the questions that come up a lot is something like, "Are we at the point where everyone in IT needs to learn to code?"

Stop Treating Your Data Engineer Like a Data Catalog

Aggregated on: 2022-05-18 17:50:55

Data trust starts and ends with communication. Here’s how best-in-class data teams proactively certify tables as approved for use across their organizations. Say it with me: data engineers are not data catalogs.

Debugging the Java Message Service (JMS) API Using Lightrun

Aggregated on: 2022-05-18 17:50:55

The Java Message Service API (JMS) was developed by Sun Microsystems in the days of Java EE. The JMS API provides us with simple messaging abstractions, including message producer, message consumer, and so on. Messaging APIs let us place a message on a “queue” and consume messages placed into said queue. This is immensely useful for high-throughput systems — instead of wasting user time by performing a slow operation in real time, an enterprise application can send a message. This non-blocking approach enables extremely high throughput while maintaining reliability at scale. The message carries a transactional context which provides some guarantees on deliverability and reliability. As a result, we can post a message in a method and then just return, which provides similar guarantees to the ones we have when writing to an ACID database.

Why to Implement GitOps into Your Kubernetes CI/CD Pipelines

Aggregated on: 2022-05-18 17:50:55

Continuous integration and continuous delivery have become essential to meet the demands of the modern software development process. CI/CD pipelines are popular within software delivery pipelines for facilitating software development and deployment tasks. However, infrastructure management is often tracked outside of CI/CD. Most of the time, infrastructure and configurations are managed outside the CI/CD pipeline, even for applications requiring rapid infrastructure modifications or configuration changes like in a containerized environment with Kubernetes. In this post, we will explore the need to implement GitOps within your Kubernetes CI/CD pipelines.

Data Collection: Methods, Definition, Types, and Tools

Aggregated on: 2022-05-18 17:20:55

Access to information gives a unique opportunity to understand the interests and demands of the customers much better and even exceed their expectations. So naturally, this makes data collection urgent, the first and most crucial step of any decision-making process. But before diving deeper into the topic, let’s get started with some essential definitions. What Is Data Collection? Data collection is gathering data; it's further measuring, processing, assessing, and analyzing for research purposes. It’s conducted with the help of established, validated techniques, which make it possible to answer research questions, test hypotheses, and evaluate final results. The main goal of data collection is to get access to reliable sources of information that will provide data for further analysis and make data-driven decisions possible.

Improving Presto Architectural Decisions With Shadow Cache at Meta (Facebook)

Aggregated on: 2022-05-18 16:50:55

Motivation and Background At Meta (Facebook), Presto is a distributed real-time query engine using SQL language as an interface to perform fast, interactive queries on petabytes of data. It supports standard ANSI SQL, including queries, aggregations, JOINs, and window functions. Alluxio is the data orchestration platform as a critical technology supporting Presto and various other data analytics applications and use cases. Alluxio creates a virtual data layer that federates data from any file system or object store, provides a unified namespace across storage systems, and serves the data to the applications using industry-standard interfaces with fast data access.

Demystifying Cloud-Native Commerce

Aggregated on: 2022-05-18 16:20:55

In today's world, both eCommerce and cloud-native are the two most important areas where technology and business innovations are fused together to build scalable and experience-driven platforms. The surge in the eCommerce space after the COVID-19 pandemic has triggered many queries in the business and technology worlds. Whether it is a small company, mid-size or large corporation, everyone has been impacted by the pandemic to a certain extent. Stores are closing. Contactless shopping and payments are becoming the norm. Supply-chain is becoming a critical issue due to transportation restrictions. Travel is getting into habitual restrictions. Cross-country shipment and local delivery are experiencing challenging times. All businesses are looking for an alternative way of doing business. In this space, direct-to-consumer is becoming the standard and online digital presence is the need of the hour.

Data Privacy Jobs Reportedly Growing While National Employment Slows

Aggregated on: 2022-05-18 16:20:55

Companies in virtually all industries use the information to some extent. Often, most of an organization’s operations revolve around collecting and analyzing it. Of course, most people in modern society know and accept that, but they assert that businesses must do whatever’s necessary to keep data safe. Recent data privacy report statistics show a high demand for people who have the training to keep information secure. As a result, they often have multiple offers to the field, even though statistics about the U.S. job market indicate the per-month growth may be becoming less robust.

Applying Design Thinking to Artificial Intelligence. Why Should You Use It in Your AI-Based Projects?

Aggregated on: 2022-05-18 15:50:55

Choosing the right project management methodology can be crucial for your project development. It will help you avoid mistakes, speed up the whole process, and support in discovering the problems of your target groups. The last issue is fundamental. Only after a deep understanding of the needs of your target group will you be able to develop a solution that will solve their problems. There are many approaches to project management focusing on discovering problems, and design thinking is one of them. AI is becoming a more significant and critical part of our lives. AI-based products and services are everywhere, from self-driving cars to voice assistants like Siri or Alexa. AI Design Thinking is the process of designing AI systems that can operate in an unpredictable environment with limited resources in a lean, iterative way. Designing for AI requires different skills than designing for other types of technology because AI doesn’t follow predictable rules and behaviors. Today, we would like to tell you more about how it can influence your process and how you can implement it into your artificial intelligence project.

Toying With Kotlin’s Context Receivers

Aggregated on: 2022-05-18 15:50:55

Kotlin added the idea of Context Receivers in version 1.6.20. In this post, I'd like to toy with them to understand how useful they can be. Note that if you want to play along, you'll need to compile with the -Xcontext-receivers flag.