News Aggregator

Fun (Scary?) Webcam Demo

Aggregated on: 2022-01-11 19:34:36

Windy is a fascinating site/app that gives real-time visualizations of wind speed and direction in your area. As a static picture wouldn't do it justice, here's my local area right now. Back during the last hurricane, I took this lovely snapshot. Not terrifying at all...

Mule CloudHub Connector: Part 2

Aggregated on: 2022-01-11 17:19:36

In Part 1 of this series, we looked at two features of Mule CloudHub Connector. In total, there are 5 features provided by this connector as listed below: Get Application List Applications Create Notification List Notifications Mark Notification In this article (Part 2), we will look at thelast 3 features of Mule CloudHub Connector from the above list.

Top Front End Development Trends You Should Know in 2022

Aggregated on: 2022-01-11 16:04:36

New trends that appear in the software world become further popular when prominent organizations adopt them or when there are promising and decisive incentives for adopting trends. Front-end development is the creation of a web portal user interface using coding and other applications such as HTML, CSS, and JavaScript. This section describes the Front-End Development Trend forecast for 2022.

Mule4 DataWeave Exercise: map, reduce, and pluck

Aggregated on: 2022-01-11 16:04:36

Using the DataWeave exercise below, I'll demonstrate how to use the reduce, map, valuesOf, splitBy functions, format, and ++ operator. Given Input: JSON [ { "empId": "ex12345", "fullName": "Peter parker", "street": "Second Ave 46", "city": "San Francisco", "state": "veniam", "postal": "sit", "country": "Mexico", "dept": "hr", "joinedDate": "2021-12-22", "miles": 68 }, { "empId": "ex54321", "fullName": "Joseph charles", "street": "First Ave 47", "city": "Bangalore", "state": "Karnataka", "postal": "560100", "country": "India", "dept": "finance", "joinedDate": "2021-11-15", "miles": 49 } ] Desired Output: JSON [ { "firstName": "Peter", "lastName": "parker", "AddrWithValuesOf": "San Francisco,veniam,sit,Mexico", "AddrWithPluck": "San Francisco,veniam,sit,Mexico", "miles": 68.00, "DateofJoin": "22-Dec-2021" }, { "firstName": "Joseph", "lastName": "charles", "AddrWithValuesOf": "Bangalore,Karnataka,560100,India", "AddrWithPluck": "Bangalore,Karnataka,560100,India", "miles": 49.00, "DateofJoin": "15-Nov-2021" } ] We can accomplish the desired output by writing the following DataWeave.

Multi-Cloud API Authorization Challenges

Aggregated on: 2022-01-11 15:34:36

As more and more companies move to a multi-cloud strategy and increase usage of a cloud-native infrastructure, API providers are under a lot of pressure to deliver APIs at scale in multi-cloud environments. At the same time, APIs should follow each company’s security requirements and best practices, no matter the cloud platform. These reasons explain why many providers have such complex API authorization requirements. Let's assume in a company that multiple teams from different lines of business are building and deploying APIs in the Azure cloud. Different teams use different technologies to build these APIs (e.g., Azure Functions, Node.js). A company might host applications that consume the APIs on the same network, such as a company's AWS account or external SaaS applications.

The ROI of Remote Work Productivity

Aggregated on: 2022-01-11 15:04:36

Remote workplace ROI is the productivity of remote workers versus that of office-based employees. This productivity is measured in terms of revenue, customers served, productivity, and other factors. ROI increases with remote productivity because the more productivity, the fewer costs that are incurred by an organization while performing similar tasks on-site or in-office.

Tutorial On Handling Keyboard Actions In Selenium WebDriver [With Example]

Aggregated on: 2022-01-11 15:04:36

During the course of automated cross-browser testing, you might come across scenarios that may not have been thought about during the product development phase. For example, when using Selenium automation testing, you could open a new browser tab instead of a new browser instance. Implementing that change would need proper usage of Keyboard Actions in Selenium WebDriver. This will also depend on whether the browser on which testing is performed and whether the Selenium WebDriver for the corresponding browser supports those functionalities. A common Selenium testing scenario is entering information in a text box by passing a combination of keys to the Selenium WebDriver. This can be achieved using the send_keys() API in Selenium which can be termed a Simple Keyboard interaction. Advanced keyboard events in Selenium automation testing are handled using Advanced User Interactions API. Using those APIs, you can perform the following:

Exploring CockroachDB With Jupyter Notebook and Python

Aggregated on: 2022-01-11 14:34:36

This is the next installment in the series of tutorials on CockroachDB and Docker Compose. I was inspired to write this post based on this article. The article goes over using Jupyter with Oracle, MySql, and Postgresql, we're going to do the same with Cockroach! One caveat here is the heavy reliance on ipython-sql library. We're going to use Pandas library as the ipython-sql magic functions are not compatible with Cockroach today. Hopefully, you will find it useful.

Speed up Large-Scale ML/DL Offline Inference Jobs at Microsoft Bing

Aggregated on: 2022-01-11 14:04:36

In this article, we will share our observations and the practice to solve the challenges while running inference at scale. By using Alluxio, we successfully speed up the inference job, reduce I/O stall, and improve performance by about 18% at Microsoft Bing. Overview Offline inference, or batch inference, is an approach to run machine learning (ML) inference in a batch mode when processing a large dataset, as opposed to generating predictions in real-time given the input. The offline inference jobs are typically built on top of big data platforms to scale horizontally, and are running on fixed schedules (e.g. hourly, daily).

Node.js vs Java: Which is Best for Your Business in 2022

Aggregated on: 2022-01-11 13:34:36

NodeJS and Java, both technologies are powerful for the back-end but which one is the best? Which one is the most relevant for web development? All of your questions will get their answers in this article. Node.js is much more popular in development these days. Some reports say that 35% of development include Java and Node.js is also gaining its users to keep good competition. Here we are going to discuss both of them in detail.

BigQuery vs Snowflake: The Definitive Guide

Aggregated on: 2022-01-11 13:34:36

The cloud data warehouse sits at the center of every modern data stack. Without a cloud-based data warehouse, it is nearly impossible to derive insights from your data. At its core, a data warehouse is an analytics platform where information from various data sources is stored for analysis. This data is used to make high-level decisions and answer pressing business queries. Today, every company is either already leveraging a data warehouse or in the process of adopting one (if you are reading this, then you are probably the latter). Although there are several key players in the data warehousing space, this post will focus solely on BigQuery and Snowflake. What Is Snowflake? Snowflake is a Software-as-a-Service (SaaS) based warehouse solution that can run on any of the popular cloud providers (AWS, Azure, GCP). It was purpose-built for the cloud and has a few key components which make it extremely unique compared to other cloud data warehouses. Snowflake was launched publicly in 2014 and has since become a major player in the data warehousing industry being valued at $90.35 billion as of October 2021.Snowflake was developed in the cloud and for the cloud. This means it comes with zero baggage and almost no management or operational overhead. As a native SaaS service, Snowflake handles all of the backend infrastructure so that you can focus on doing what matters most: deriving insights from your data. Snowflake offers a ton of scalability enabling near-unlimited concurrent queries.

Java: How Object Reuse Can Reduce Latency and Improve Performance

Aggregated on: 2022-01-11 13:04:36

While the use of objects in object-oriented languages such as Java provides an excellent way of abstracting away complexity, frequent object creation can come with downsides in terms of increased memory pressure and garbage collection which will have an adverse effect on applications’ latency and performance. Carefully reusing objects provide a way to maintain performance while keeping most parts of the intended level of abstraction. This article explores several ways to reuse objects.

Site Reliability Engineer (SRE) Roles and Responsibilities

Aggregated on: 2022-01-11 12:34:36

Software development is getting faster and more complex – frustrating IT operations teams more than ever. So, DevOps gained popularity in order to combat siloed workflows, decreased collaboration, and a lack of visibility. While establishing a culture of DevOps has helped teams collaborate better and deliver reliable software faster, DevOps teams don’t necessarily have someone specifically dedicated to developing systems that increase site reliability and performance. That’s where a site reliability engineer (SRE) comes into the picture. The concept of SRE was initially brought to life by Google engineer, Ben Treynor. Then, shortly after implementing SRE, they published their popular SRE eBook – helping the movement gain traction in the industry. Site reliability engineers sit at the crossroads of traditional IT and software development. Basically, SRE teams are made up of software engineers who build and implement software to improve the reliability of their systems.

Inspecting Cloud Composer - Apache Airflow

Aggregated on: 2022-01-11 12:04:36

Introduction Cloud Composer is a fully managed service built on Apache Airflow, it has built-in integration for other GCP services such as Cloud Storage, Cloud Datastore, Cloud Dataflow, Big Query, etc. The integration is important from an Airflow scheduling and automation perspective, say a DAG is written for pulling file (.csv) from Cloud Storage, executing transformation using Pandas and again uploading back to Storage or performing some DB Operations.

Humanizing Agile

Aggregated on: 2022-01-11 04:34:36

“Can we get serious now?” quipped Captain Charles Sully Sullenberger, the iconic character played by Tom Hanks in the movie adaptation of the Airbus A320 Hudson Water landing incident. He goes on to articulate the crux of his argument in the safety hearing: “You are taking humanity out of the cockpit while looking for human errors.” I have a feeling - more from experience - that many of the Agile implementations that are done in organizations suffer from this very same issue: humanity is taken out of Agile. This is a sad irony as Agile by design is meant to amplify people practices. There are several manifestations of this in Agile. Task sign-up, self-organizing teams, servant leadership, a daily Scrum meeting, team retrospective, and various principles are all examples of the human side of Agile.

Reactor Design Pattern in Java

Aggregated on: 2022-01-11 04:34:36

In the video below, we take a closer look at the reactor design pattern in Java, with an introduction and an example of implementation. Let's get started!

How to Consume REST Web Service (GET/POST) in Java 11 or Above

Aggregated on: 2022-01-11 03:49:35

RESTful web services are the de-facto way of integrating first- and third-party services in web and mobile applications. When programming in Java, there are a plethora of options on how to consume REST APIs, however many of them are either out of fashion or too complicated. At my company, we provide developers Java SDK to build on top of our open platform, and the most common operation involves making authenticated web requests to get data from the RingCentral platform. In this tutorial, we will learn how to use the standard HTTPClient class that comes in JDK 11.0 or later as part of java.net.http. We will use that to create RestClient, send HTTP GET and POST requests with JSON body, and handle the JSON response using the body handler object.

Mock APIs Using sMockin

Aggregated on: 2022-01-11 00:04:35

Hi Everyone, The main goal of this article will be to explain how to improve our time when is required to integrate with a third-party system. Usually, it is an API and the developer doesn't have control over it. Moreover, the developer usually needs to mock the API, the sMockin could help the teams with this hard task.

Domain Model Design Pattern in Java - An Introduction and Examples

Aggregated on: 2022-01-10 23:49:35

In the video below, we take a closer look at Domain Model Design Pattern in Java including an introduction and examples. Let's get started!

A Stress-Free 2022

Aggregated on: 2022-01-10 19:04:35

There are ample resources available online to deal with burnout in your job, but I want to share a few ideas that I will be using this year. The WHO says: “Burn-out is a syndrome conceptualized as resulting from chronic workplace stress that has not been successfully managed.” You know that it is happening to you when a part of your inner self is screaming that you have had enough. Perhaps, you want to say it out loud, too. IT jobs seem to have a high percentage of burnout, and Electric identifies that it is rising. January is the month when employees return from a festive break to start afresh and tackle new challenges. However, IT professionals return to the unfinished backlog, pushed deadlines, and overcommitted sprints from December. Long hours, growing to-do lists, work setup issues, uncountable Slack messages, and remote teams all contribute to stress. We all face it. Long hours and working over the weekends contribute to the biggest reasons for burnout. Teams work throughout the week, release during the nights, and provide support over the weekends, and the cycle continues.

How To Detect and Secure Your Java App From Log4j Vulnerabilities

Aggregated on: 2022-01-10 18:34:35

Apache Log4j is the popular open source logging library for Java developers that was recently caught up in a massive security-related breach. Due to its popularity, a large number of organizations were affected by the breach. For the latest news, refer to the official website about specific issues and patches. Here is an additional article that explains the core issues in detail. List of Security Issues That Were Found in Log4j Version 2.x: CVE-2017-5645: Apache Log4j socket receiver deserialization vulnerability (Severity - Moderate) CVE-2020-9488: Improper validation of certificate with host mismatch in Apache Log4j SMTP appender (Severity - Low) CVE-2021-44228: Apache Log4j2 JNDI features do not protect against attacker-controlled LDAP and other JNDI-related endpoints (Severity - Critical) CVE-2021-45046: Apache Log4j2 Thread Context Lookup Pattern vulnerable to remote code execution in certain non-default configurations (Severity - Critical) CVE-2021-45105: Apache Log4j2 does not always protect from infinite recursion in lookup evaluation (Severity - Critical) CVE-2021-44832: Apache Log4j2 vulnerable to RCE via JDBC Appender when attacker controls configuration (Severity - Moderate) 4 Ways To Secure Your Java Application: 1. Detect if You Have Log4j 2.x in Your Code Base Apache Log4j can be in your project directly or a dependency of a dependency. Thus, it's best to use a build tool such as Maven or Gradle to quickly scan for the same tree as follows:

How To Build Self-Hosted RSS Feed Reader Using Spring Boot and Redis

Aggregated on: 2022-01-10 18:34:35

Keeping on top of your RSS feeds can be a headache. If you have many feeds that you follow, then trying to keep tabs on the status of each one is just as tedious as difficult. And let’s be honest, having to dig through the online clutter and pull out the feed you want to monitor is a time-consuming process that nobody wants to experience. These inconveniences created an itch that Sandeep Gupta couldn’t ignore, which spurred him to create an application that pulls all RSS feeds into one location. This provides users with a holistic view of all their RSS feeds, promoting a painless and efficient way of organizing their entire collection. Using different Redis modules, Sandeep was able to create an application that’s hyper-responsive to user commands, minimizing the chances of any lags or delays from happening.

What Log4j Vulnerability Means for SREs

Aggregated on: 2022-01-10 18:04:35

If you’re an SRE, you’ve almost certainly heard all about Log4Shell, the Log4j vulnerability that some analysts are calling the worst software security flaw in decades. And you’ve also hopefully by now patched any systems you manage to fix the vulnerability (if you haven’t, go do that right away!). Even after you’ve patched Log4Shell in your environments, though, you shouldn’t put the vulnerability in the back of your mind. For SREs, there are some important lessons to glean from this fiasco.

Let the Oracle Database Operator for Kubernetes Do the Job

Aggregated on: 2022-01-10 16:49:35

Hello everyone! New Year, New Life, and finally, old dreams and goals are coming out of the paper. For my first blog, at the beginning of 2022, I chose to talk about Oracle Database Kubernetes Operator, a.k.a OraOperator. In this post, I'll talk about Oracle Database Kubernetes Operator, a.k.a OraOperator, and offer a gentle introduction to Kubernetes Operator and Cloud-Native Architecture -- base for all.

Penetration Testing 101: A Beginner’s Guide to Ethical Hacking

Aggregated on: 2022-01-10 16:49:35

Every day, we use and generate huge amounts of data. And this data is used by different sectors like healthcare, finance, marketing, and others. However, data breaches are increasingly rampant these days. That’s why such sensitive information should be safeguarded. This is where penetration hacking comes in handy. Penetration testing or ethical hacking is used to get access to resources. Hackers carry out attacks to uncover security vulnerabilities and assess their strengths.

How To Use NUnit Annotations For Selenium Automation Testing [With Example]

Aggregated on: 2022-01-10 16:49:35

When it comes to using object-oriented programming languages for development & testing, C# is still considered a good choice by the developer community. MSTest/Visual Studio, xUnit.net, and NUnit are some of the top-most frameworks that can be used for automated browser testing. While using NUnit, you can further leverage the capabilities of NUnit Annotations to build a more robust framework. Any discussion about testing is incomplete without the mention of the Selenium framework. Selenium is a powerful test framework that can be used for automated browser testing as it is compatible with popular programming languages like C#, Python, etc.

The Engineer's Complete Guide to Backlog Grooming

Aggregated on: 2022-01-10 16:49:35

You might be an organized checklist kinda person, or you might be hopelessly unorganized like the rest of us. It’s generally not such a big deal until you get overloaded with tasks and your team grows, making things even more confusing as you can’t decide each day what to prioritize. Fortunately, there’s a way forward.

A Tentative Comparison of Fault Tolerance Libraries on the JVM

Aggregated on: 2022-01-10 16:49:35

If you're implementing microservices or not, the chances are that you're calling HTTP endpoints. With HTTP calls, a lot of things can go wrong. Experienced developers plan for this and design beyond just the happy path. In general, fault tolerance encompasses the following features: Retry Timeout Circuit Breaker Fallback Rate Limiter to avoid server-side 429 responses Bulkhead: Rate Limiter limits the number of calls in a determined timeframe, while Bulkhead limits the number of concurrent calls A couple of libraries implement these features on the JVM. In this post, we will look at Microprofile Fault Tolerance, Failsafe, and Resilience4J.

Mule CloudHub Connector: Part 1

Aggregated on: 2022-01-10 16:49:35

What are CloudHub Connectors? This helps you connect to CloudHub APIs through Mule applications. In total, there are 5 features provided by this connector as listed below: Get Application List Applications Create Notification List Notifications Mark Notification In this article, we are going to look at the first 2 features using a simple demo.

Streaming Data Exchange With Kafka and a Data Mesh in Motion

Aggregated on: 2022-01-10 16:49:35

Data Mesh is a new architecture paradigm that gets a lot of buzz these days. Every data and platform vendor describes how to build the best Data Mesh with their platform. The Data Mesh story includes cloud providers like AWS, data analytics vendors like Databricks and Snowflake, and Event Streaming solutions like Confluent. This blog post looks into this principle deeper to explore why no single technology is the perfect fit to build a Data Mesh. Examples show why an open and scalable decentralized real-time platform like Apache Kafka is often the heart of the Data Mesh infrastructure, complemented by many other data platforms, to solve business problems. Data at Rest vs. Data in Motion Before we get into the Data Mesh discussion, it is crucial to clarify the difference and relevance of Data at Rest and Data in Motion:

API Prototyping with Postman

Aggregated on: 2022-01-10 16:49:35

Introduction Whether you’re a longtime Postman developer or new to the platform, Postman brings you all the tools you need to make the process easier, faster, and more streamlined. In this article, we’ll show how Postman can help you start building the core of your API-driven integration on both sides of the API—either as the provider or the consumer.

How to Make Your Scrum Master Fail

Aggregated on: 2022-01-10 16:49:35

Scrum has proven time and again to be the most popular framework for software development. Given that software is eating the world, a seasoned Scrum Master is nowadays in high demand. And that demand causes the market entry of new professionals from other project management branches, probably believing that reading one or two Scrum books will be sufficient. Which makes any Scrum Master interview a challenging task. A good starting point, though, is to ask a candidate to walk in the shoes of an imaginary opponent trying to make the Scrum Master fail by culturally accepted means. Suppose you are looking to fill a Scrum Master (or agile coach) position in your organization. In that case, you may find the following interview questions helpful to identify the right candidate. They are derived from my sixteen years of practical experience with XP and Scrum, serving both as Product Owner and Scrum Master, and my training experience as a Professional Scrum Trainer with Scrum.org. Also, I have interviewed dozens of Scrum Master candidates on behalf of my clients.

Best Technical Blogging Tips in Under 30 Seconds

Aggregated on: 2022-01-10 16:49:35

Before you start writing, have the answers to the questions below. You can revise, iterate the answers as you write. This will make your blog crisp and help you to ship. Question Who’s the audience? What audience questions will the blog answer? YOU CAN STOP HERE. Start thinking and writing. Everything else is secondary – Tips, tricks, rules, and all.

Using GraphQL Java With Spring

Aggregated on: 2022-01-10 13:34:35

GraphQL Java is one of the most popular GraphQL server-side implementations for Java that I’ve found (with over 5k stars at the time of writing). If you’re planning to expose a GraphQL API from a Java or JVM application, then this is an excellent library to start using. This blog post will cover how to use GraphQL Java within a Spring application that exposes an endpoint for clients to send queries to. GraphQL Java does have its own official documentation covering this subject; however, I found it a bit too simplistic, which made it harder for me to wrap my head around it. I hope you don’t think the same about the content of this post, although I guess you could write your own that is even more complicated than my examples!

Multiple Entry Points for the NgxSimpleCharts Angular Library

Aggregated on: 2022-01-10 13:34:35

Angular Libraries can grow to a significant size. An Angular Library that is created with 'ng generate library ngx-simple-charts' is a single piece of code that will be included in the first module that includes/uses it. That module probably will impact the first initial useful paint. To solve that problem multiple entry points can be used. These entry points provide the feature to include only the code of the entry point in the module. Lazy loaded modules can include the code of other entry points. That makes it possible to spread out the code to the modules that use it and lowers the size of the modules to the necessary size.

How Zero Trust Will Change Incident Response

Aggregated on: 2022-01-10 10:49:35

Image Source: Pixabay What Is Incident Response? Incident response involves responding to potential threats, such as unauthorized access to a corporate network. An event can be a sign of a breach or a false positive. However, it still requires investigation to determine the appropriate response.

Enterprise Architecture Governance: A Holistic View

Aggregated on: 2022-01-09 16:49:34

Introduction Governance is the way in which an organization is run and controlled [1]. Governance is the way rules, norms, and actions are structured, sustained, regulated, and held accountable [2]. Generally, governance is categorized into three types based on the nature of the organization, type of outcomes desired, and practical agenda of the organization [3-12].

Why a Developer Should Be a Bit of a Cloud Engineer: The Need for Cloud Services

Aggregated on: 2022-01-08 16:49:34

A Short Background I characterize myself as a slothful engineer due to the specificity of my behavior: rather than duplicating, mentioning different issues in my project, and setting up new appliances to be more efficient, I would be grateful for the opportunity and get back on my way. My first job as a professional started in the entertainment industry where I had to do my projects really quickly before the deadline was over; moreover, it was not possible to use high-end tools or spend a lot of time researching and integrating peculiar properties. That is the reason why I decided to spend some overtime hours researching and showing my teammates how a few specific tools could improve the process, and show how to have a greater impact in solving technical problems.

Java 17 for the Impatient

Aggregated on: 2022-01-08 16:19:34

I have been working on Java 8 for a long time and, now, Java 17 has been released, so let's have a quick look at this article which focuses on the latest Java 17 LTS features. There are lots of features and improvements that have been introduced, however, in this article, we will focus on a limited set:

Develop a Spring Boot REST API in AWS: PART 4 (CodePipeline / CI/CD)

Aggregated on: 2022-01-08 16:19:34

This is the last video (part 4) in this demo series. We will demonstrate how to create the whole CICD pipeline in this tutorial video. It involves the following steps:

The Quickest Way to Create an Android QR Code Scanner

Aggregated on: 2022-01-08 16:19:34

A QR code scanner application primarily consists of two parts: camera preview and QR code scanning. There are many Android QR code scanner apps downloadable in the Google Play Store. However, it is more interesting to create a QR code scanner by yourself than to use an existing one. This article aims to reveal the quickest way to create an Android QR code scanner. You will see how to step by step implement camera preview, as well as how to integrate QR code scanning SDK. Prerequisites The following Android libraries are required in order to implement the QR code scanner. You can feel free to replace them with your own libraries.

Engineering Manager: Beyond Leadership

Aggregated on: 2022-01-08 16:19:34

This is a follow-up article in the Engineering Manager series, My First Thoughts as an Engineering Manager and Engineering Manager: Do Not Be a Hero. Nowadays, I see more and more the words "leader" and "leadership". Often, I ask myself what these words mean for the people and the companies: What is a leader? How many kinds of leaders are? What are the companies looking for? Do we need so many leaders? Can we hire leaders? In this article, I am not going to talk about a leader in deep because I feel there are many articles about it, but how this role is overrated and why an Engineering Manager is not the synonym of a "leader".

Business Delegate Design Pattern in Java

Aggregated on: 2022-01-08 16:19:34

In the video below, we take a closer look at the Business Delegate Design Pattern in Java. This tutorial includes an introduction, a real-time example, implementation, and key points. Let's get started!

What Is Agile Development (Part 2): Agile in SAP

Aggregated on: 2022-01-08 16:19:34

SAP is trusted the world over by leading organizations to handle critical business processes and functions. Unfortunately, making changes to SAP systems in response to evolving business needs can be tedious and cumbersome. Much of the rest of the software development world has adopted new methodologies, such as agile, that enable them to deliver changes and updates to critical systems more quickly and efficiently.

Debunking Four Metadata Myths

Aggregated on: 2022-01-07 22:04:34

Data is being accumulated at an alarming rate due to the growth of unstructured data. Within that is metadata, which allows us to quickly find data files by identifying certain properties. It wasn’t until recently that developers had to pay closer attention due to the overwhelming effect it was having on our data engines. Metadata used to just be a thing that could be stored in memory behind the scenes without any worry, but its expansion presents the growing concern of where to store it and how to manage it. Every database system, whether SQL or NoSQL, uses a data engine (aka storage engine), embedded or not, to manage how data is stored. Our ever-growing volume of data has outgrown our data engines’ infrastructures and with that, they are stretched to their limits and forced to make painful trade-offs necessary to support the scale and performance requirements of modern datasets.

How To Decrease Risk of Presenteeism When Ending Remote Working

Aggregated on: 2022-01-07 15:34:33

Absenteeism has always been considered a big problem in business workplaces, and most entrepreneurs try to deal with this to ensure that their organization remains productive. When the pandemic-led crisis forced many organizations to embrace work from home or remote work protocols, another crisis cropped up to thwart productivity. This new problem is called presenteeism. Presenteeism means showing presence while not remaining productive enough as desired for the job role. The problem has particularly become rampant in some employees working remotely or from home. When hiring remote developers for a project, you see all the team members present on the web. Still, the output is not satisfactory, making the company doubt the work ethics of respective team members.

SQL vs NoSQL Database – A Complete Comparison

Aggregated on: 2022-01-07 15:34:33

There are two main categories of databases in use in the developing world today, commonly referred to as SQL and NoSQL. In this article, we will compare an SQL vs. NoSQL database based on its pros and cons. SQL, or Structured Query Language, is the universally known query language for relational databases. SQL databases make it simpler to work with structured data in a database through CRUD operations. CRUD stands for create, retrieve (or read), update, and delete – the primary operations for manipulating data.

How to Design a Better Decision Tree With Pruning

Aggregated on: 2022-01-07 15:34:33

Decision tree (DT) analysis is a general and predictive modeling tool for machine learning. It is one of the simplest and most useful structures for machine learning. As the name indicates, DTs are trees of decisions. By using an algorithm approach for splitting data sets according to different conditions, decision trees are constructed. A decision tree is one of the commonly used and functional techniques for supervised learning. But before moving on to designing decision trees with pruning, let’s understand its true concept.

3 Types of User Communication APIs and When to Use Them

Aggregated on: 2022-01-07 15:04:33

If you’re an engineer who’s been tasked with planning out your application’s communication strategy, this post will help you map out the landscape. You’ll come away understanding the three core types of user communication APIs and in which circumstances you should use them to create the best possible end-user experience. As modern applications have become increasingly feature-rich and performant, user expectations are at an all-time high. Failure to communicate key information or displaying out-of-date information frustrates users and causes a loss of trust. Think about the last time you ordered something online: if you didn’t receive your order confirmation within seconds, you probably began to worry that something went wrong. Users require product transparency for consistent use.

Import Data From Hadoop Into CockroachDB

Aggregated on: 2022-01-07 14:34:33

CockroachDB can natively import data from HTTP endpoints, object storage with respective APIs, and local/NFS mounts. The full list of supported schemes can be found here. It does not support the HDFS file scheme and we're left to our wild imagination to find alternatives. As previously discussed, the Hadoop community is working on Hadoop Ozone, a native scalable object store with S3 API compatibility. For reference, here's my article demonstrating CockroachDB and Ozone integration. The limitation here is that you need to run Hadoop 3 to get access to it. What if you're on Hadoop 2? There are several choices I can think of off the top of my head. One approach is to expose webhdfs and IMPORT using an http endpoint. The second option is to leverage previously discussed Minio to expose HDFS via HTTP or S3. Today, we're going to look at both approaches. My setup consists of a single-node pseudo-distributed Hadoop cluster with Apache Hadoop 2.10.0 running inside a VM provisioned by Vagrant. Minio runs as a service inside the VM and CockroachDB is running inside a docker container on my host machine. Information on CockroachDB can be found here. Information on Hadoop Ozone can be found here. Information on Minio can be found here. Upload a file to HDFS. I have a CSV file I created with my favorite data generator tool, Mockaroo. curl "https://api.mockaroo.com/api/38ef0ea0?count=1000&key=a2efab40" > "part5.csv" hdfs dfs -mkdir /data hdfs dfs -chmod -R 777 /data hdfs dfs -put part5.csv /data