News Aggregator

Connect Streamlit to SingleStore

Aggregated on: 2022-02-04 12:49:52

Abstract This article will show how SingleStore can be quickly used with Streamlit, an open-source application framework for Machine Learning and Data Science. Introduction The Streamlit documentation describes how to connect Streamlit to MySQL. It is trivial to adapt the code to work with SingleStore. Let's see how.

Adding Barcode Support to a Salesforce Mobile Application

Aggregated on: 2022-02-04 12:19:52

Mobile devices have become a core aspect of our lives. Of course, this can be a good and bad thing. However, for the purposes of this article, I’ll focus on the positive ways mobile devices enrich our lives. In fact, when my college-senior son, Eric visits, our conversations often provoke Eric to use his phone to locate and validate information related to our discussions. The crazy thing is: No matter what we talk about, his favorite search engine and voice-to-text skills provide an almost-immediate answer.

Large-Scale Web Scraping: How To Do It?

Aggregated on: 2022-02-04 12:19:52

As capturing information is having immense demand, businesses realize the value of data extraction. Any business that wants to scale up should do web scraping at a larger scale. It can provide benefits like improved lead generation, support prize optimization, and collecting business intelligence. However, data extraction from websites is quite difficult and time taking process that has several complexities. There are inconsistent site layouts that fragment the extraction logic into poorly written HTML, thus, making scraping websites difficult. Many challenges are there when it comes to web scraping at a huge scale that you should know before proceeding to scrape websites.

Getting Started With CockroachDB on Red Hat OpenShift

Aggregated on: 2022-02-04 11:49:52

I write about CockroachDB against/along wide-ranging systems, frameworks, integrations, etc. Here is a list of my previously published CockroachDB articles. Prerequisites OpenShift CodeReady Containers: 4.5.9 CockroachDB: 20.1.5 CockroachDB Kubernetes Operator: 1.0.1 Note: I'm using CodeReady Containers from Red Hat, the link requires login. OpenShift CRC Installation Feel free to refer to the RH docs to install the CodeReady environment:

Azure Translator Service - Translate Document From One Language to Another

Aggregated on: 2022-02-04 11:04:52

In this article, I’m going to write about another interesting Azure-based service named Translator, which falls under the umbrella of Azure Cognitive Services. This service helps us to translate documents from one language to another and at the same time, it retains the formatting and the structure of the source document. So, let’s say, if any text in the source document is in italics, then the newly translated document, will also have the text in italics.

I'm From Ops, Should I Do Chaos!

Aggregated on: 2022-02-04 10:04:52

Chaos Engineering is a useful technique to prepare the teams to respond to production issues and reduce application downtime. In this article, an Ops team member who is involved in conducting chaos engineering puts forth his/her perspective, challenges, and expectations with respect to chaos engineering. Ops in the context of this article are the team responsible for releasing software, provisioning infrastructure, managing production support, and monitoring applications in production. I love stability. DevOps experts tell me that those days of working in silos are gone and I should collaborate with the Dev team for all ‘continuous…’ culminating in continuous production deployment. Agree, and totally.

Introduction to Couchbase for Oracle Developers and Experts: Part 5: Statements and Features

Aggregated on: 2022-02-04 09:04:52

SQL is the only 22nd century tool available in 21st century Here are the previous articles comparing architecture, database objects, data types, and data modeling of Oracle with Couchbase. This will focus on SQL support. Oracle was the first and staunch supporter of SQL. Oracle's SQL implementation beat IBM to market by two years. That changed the fortune of one or two people. :-) All of the modern relational databases implement SQL. So much so, the relational databases are sometimes called SQL databases, much to the chagrin of C. J. Date. Nations are known by their languages... English, French, and American(!). It's not a stretch for a class of database systems to be known by their languages as well. SQL has been so effective, many big data and non-relational systems have picked up SQL as the lingua franca. SQL is here to stay, even for NoSQL systems.

Cloud Migration Checklist

Aggregated on: 2022-02-03 22:34:52

In several cases where IT executives work towards moving key enterprise applications to the public cloud, their teams struggle or have limited success in their cloud migrations. However, they never give up and they use these lessons to improve their results in subsequent attempts. If your organization is wanting to modernize mission-critical applications and you’re designing a cloud migration as a locality of this process, you don’t wish to repeat others’ mistakes.

Role of Artificial Intelligence for Government

Aggregated on: 2022-02-03 22:04:52

Introduction For the last 20 years, the research on artificial intelligence has been very aggressive, which has resulted in great innovations. Big data, robotics, medical research, and autonomous vehicles are some of the applications that emerged from AI development. Government interest in AI has picked up in recent years as many government departments started to invest in AI in the form of pilot programs for various AI-based applications. AI adoption acts as a lever for transformational change in the way government services are conceived, designed, delivered, and consumed. It helps the government to provide integrated services to its citizens through the seamless flow of information across government departments. In addition, the adoption of AI helps in redesigning government processes, frees up staff, increases productivity, and improves citizen interactions.

Testing Serverless Functions

Aggregated on: 2022-02-03 21:34:52

Serverless computing, or functions-as-a-service, has picked up a lot of attention and speed due to its cost-effective pay-as-you-go price offering, multi-language/runtime support, as well as its easy learning curve without any need to provide the infrastructure layer. All the major cloud providers now have a serverless computing offer as part of their services portfolio: Amazon Web Services has Lambda, Microsoft Azure has Azure Functions, and Google Cloud has Cloud Functions. Furthermore, there are on-prem/on-Kubernetes options for running serverless functions on OpenWhisk or OpenFaaS. For the sake of consistency, I will refer to all of these services as serverless functions throughout the rest of this post. In a microservices (or even nanoservices, as serverless functions are sometimes known) architecture, there are inherently lots of components, modules, and services that form part of an application or platform. This can make testing a chore, and sometimes a neglected part of the SDLC for these platforms. This article will explore some options and techniques for testing these types of platforms to help make this aspect of your projects easier. Testing should always be a first-class citizen, regardless of the infrastructure. Irrespective of the language, framework, or tools we use, testing is vital to ensure both sustained development velocity and the quality of our deliveries to production.

How To Boost Staff Retention and Empower Employees Using NodeJS, React, and Redis

Aggregated on: 2022-02-03 19:49:52

Employees are the lifeblood of every business, making it absolutely crucial to align the right personnel with the right job. Doing so will transform a business into a well-oiled machine where every cog performs with maximum efficiency. Those who don’t will experience the rust that comes from a job mismatch, which usually translates to less productivity, high staff turnover rates, and blighted profits. Having a poor employee retention rate is expensive, but trying to find the right candidate is a time-consuming process. What’s quite often the case is that businesses already have these skills available to them in their workforce, and only require a system that can transfer employees to positions that correspond with their talents.

Static Analysis with ESLint and LWC

Aggregated on: 2022-02-03 16:34:52

As we learned in our last post, static analysis is useful in various situations, whether that’s keeping a codebase consistent, catching potential performance issues, or rewriting code to be more idiomatic. In our previous post, we used PMD to analyze Apex code. In this post, however, we’ll consider how to analyze another Salesforce programming environment: Lighting Web Components. Salesforce developed Lightning Web Components (LWC) as a fast, enterprise-grade wrapper around vanilla web components. LWC is built on the same HTML, CSS, and JavaScript that powers the web, so any analyzer for those languages can be applied here.

How to Maintain Quality when Transitioning from Monolith to Microservices

Aggregated on: 2022-02-03 16:34:52

Piece by piece, legacy monolith applications are being broken down and replaced by microservices. Organizations large and small are making the transition, but that doesn’t mean the transition is easy. Until recently, the challenge of transitioning well has held up many organizations, but there are some options to make this easier. In this post, we’ll look at some of the critical metrics to monitor when making the transition, along with helpful tools to get you from monolith to microservices. The why and the how Organizations make the switch to microservices for several reasons. When an application is broken into small pieces, those pieces are easier to test and quicker to deploy. With this modularization also comes more clearly scoped responsibilities for developers and teams.

How To Benchmark the End-to-End Performance of Different I/O Solutions for Model Training

Aggregated on: 2022-02-03 15:19:52

This blog will demonstrate how to set up and benchmark the end-to-end performance of the training process. Architecture The typical process of using Alluxio to accelerate machine learning and deep learning training includes the following three steps:

New Open-Source Multi-Cloud Asset to build SaaS

Aggregated on: 2022-02-03 09:04:51

Over the last months I’ve worked with many companies who want to build SaaS (Software as a Service) to scale their solutions to new markets and to save costs. To address these needs, our team has produced an asset that demonstrates how to build cloud-native applications that can be deployed to multiple clouds and how they can be exposed in multiple marketplaces. Red Hat OpenShift is a perfect technology to address these requirements. Check out the SaaS repo.

How to Use SQL to Directly Query Files

Aggregated on: 2022-02-03 01:49:51

Have you ever been sent a file and asked to find important information buried within it? Your coworkers would be very impressed if you could query the files in a quick and efficient manner. But... how exactly are you going to achieve such a feat? As you probably know, SQL allows you to modify database data quickly and easily. When trying to work with data files, developers usually load data into a database and manage it via SQL. In a perfect world, you could just query the database to get the information your company needs. But in real life, there's a catch: data loading is often not straightforward.

Setting Up A Docker Registry As Pull Through Cache

Aggregated on: 2022-02-03 01:19:51

In our last blog post, Peter talked about how to Simulate A Docker Hub Outage, where he gave some context on what a pull-through cache (aka registry mirror) is and why Shipyard needs to mirror parts of Docker Hub. Peter described the implementation as straightforward. While he’s not exactly wrong, I wanted to share some gotchas and tell you some caveats that I wish I knew before implementing this.

Using SingleStore as a ML Feature Store

Aggregated on: 2022-02-03 00:49:51

Abstract This article quickly shows how SingleStore can be used as an online Machine Learning Feature Store with just a few changes to a code example provided on GitHub. Introduction Feast (Feature Store) is described as follows:

React Form Libraries Comparison: Formik Vs React Hook Form

Aggregated on: 2022-02-02 23:34:51

Forms are the most common interactive tool we can encounter in many applications and also the challenging part to collect and preserve the data. There are multiple libraries that we can use such as React Final Form, Formik, Redux Form, and React Hook Form. In this article, we will focus on how React can solve the problem of working with forms, and we will discuss two well-known libraries called React Hook Form and Formik. React Components Firstly, I would like to explain the difference between the controlled and uncontrolled components. The HTML elements <input> and <select> differ from the other DOM elements by having their proper internal state. React’s official page recommends giving the control of changing the value of these form elements to the library itself since in React there is the principle of "the state is the single source of truth." In this way, the components which have their states managed by React are called “controlled components." On the other hand in the official page, also mentions that we may use uncontrolled components: like writing an event handler and piping all of the input state through a React component.

Hacking PostgreSQL Internals to Deliver Push Notifications

Aggregated on: 2022-02-02 23:34:51

PostgreSQL announced its latest version (PostgreSQL 14) on September 30th, which includes a bunch of features like pipeline API, gathering statistics on replication slots, query parallelism improvements and so on. While the origin of PostgreSQL can be traced back to 1986, it has been in active development for the past 30 years. Tons of companies, agnostic of the the type and size, have trusted Postgres over the years and their tagline “The world's most advanced open source relational database” is hardly an overstatement.

Interpreter Design Pattern in Java

Aggregated on: 2022-02-02 22:49:51

In the video below, we take a closer look at the Interpreter Design pattern in Java. This tutorial includes an introduction, real-time examples, a class diagram, and implementation. Let's get started!

How to Secure AWS API Gateway With Cognito User Pool

Aggregated on: 2022-02-02 21:19:51

In this blog, you will learn how to configure an AWS API Gateway backed by an AWS Java Lambda. Next, you will learn how to secure the API by means of an AWS Cognito User Pool. Enjoy! 1. Introduction AWS API Gateway is a managed service which allows you to manage your API. It has many features available like creating the API, publishing it, securing it, versioning it, etc. Some of the features will be covered in this blog, but certainly not all of them.

AWS DynamoDB Table Design in 10 Minutes

Aggregated on: 2022-02-02 19:49:51

AWS DynamoDB is a serverless key and value pair NOSQL database. The schema design concept is different from traditional relational database. You can understand the DynamoDB table design within 10 minutes in this video. Thank you for watching!

How To Persist and Query Data With SQLite in Flutter App Development

Aggregated on: 2022-02-02 19:49:51

Persisting and querying a large amount of data on the local device is important to make a highly performant Flutter application. This data must remain intact in each app session. Hence, you need to have an advanced database management system to locally store your more complex and interdependent data. SQLite should be your pick in this scenario as it emphasizes concurrency, scalability, reliability, centralization, simplicity, and control. When it comes to Flutter app development, you can use the SQLite database the right way via the sqflite package available on pub.dev. You can have complete control over your queries, database, relationships, or everything you desire to improve the performance of your Flutter apps.

What Is Connection Pooling, and Why Should You Care?

Aggregated on: 2022-02-02 18:34:51

As a developer, you may not have spent a lot of time thinking about database connections. A single database connection is not expensive, but as things scale up, problems can emerge. So let's (ahem) dive into the world of connection pooling, and take a look at how it can help us build more performant applications, especially when we're operating at scale. A Typical Database Connection Before we get into pooling, let's quickly review what happens when your application connects to the database to perform a database operation:

OpenAI: A Blessing or a Curse

Aggregated on: 2022-02-02 18:34:51

The human desire to avoid mundane chores and simplify all tasks is as strong and persisting as humanity itself. Through the ages, this desire manifested itself in many forms. Some, such as slavery or serfdom, were definitely cruel and only served the very few. Later on, the aristocracy went to great lengths to make their lives the best they could be, relying on an entourage of servants to tend to their every need. As the Industrial Revolution introduced the miracle of large-scale manufacturing and eventual automation, we finally discovered a way forward that would not rely on human workers.

Building an Integration to Another App: How To Get Started

Aggregated on: 2022-02-02 18:04:51

[Ding!] goes your email notification. You’ve just been assigned a new ticket. The subject line reads “Integrate our app with Acme CRM.” The ticket’s description is pretty sparse - just a few bullet-points saying things like: Sync users’ appointments in Acme with our calendar app. Track the number of email and phone touch-points users have in Acme on our dashboard. You expected this. A lot of the businesses that use your software also use Acme CRM, and you’ve been hearing from your sales and support teams that customers keep asking for their Acme data to sync with your app.

Migration From .NET5 to .NET 6: Performance Benchmarks

Aggregated on: 2022-02-02 17:04:51

Introduction This post continues the series of articles (Migration from .NET Core 2.2 to .NET Core 3.1 and How to Migrate a Project From ASP.NET MVC to ASP.NET Core) on upgrading the nopCommerce project – a free .net eCommerce CMS with an open-source code for creating online stores. This article discusses why we continuously strive to upgrade our application’s platform. Here we tell you what we achieved with migration to .NET 6 in terms of performance and try to evaluate our results practically.

Introduction to Overhide-Ledger and Ledger-Based Authentication

Aggregated on: 2022-02-02 16:34:51

I'd like to introduce overhide-ledger, a free, open-sourced, centralized web 2.0 ledger of dollar transactions exposed through a minimal API. The intent of the ledger is to enable a simple authorization workflow that's useful both today, for dollars, and tomorrow, for cryptos.

The Dark Side of Coding Bootcamps To Consider When Entering

Aggregated on: 2022-02-02 16:34:51

Back in 2012, the learn-to-code movement arrived. The demand for complementary skills in many industries promised alternative sources of income together with a comprehensive experience, including soft skills like creative thinking, problem-solving, and critical judgment. As some of you probably remember, the don't-learn-to-code movement came soon after. The backlash from experienced programmers and educators might have seemed malicious, but, emotions aside, their points were quite reasonable:

Using Remote Testing With .NET Core

Aggregated on: 2022-02-02 15:34:51

It's no secret that .NET Core is becoming increasingly popular. As a result, more developers are creating .NET applications on Windows and then deploying them on Linux. This trend is understandable, as there are many differences between these platforms. For this reason, it's important to run your debugging tests directly on Linux to avoid errors in production. But using Docker to debug your application on Linux can be tricky and time-consuming, and setting up a remote SSH connection can be challenging if you haven't done it before.

A Guide To Eliminate Common Performance Issues in React Native App Development

Aggregated on: 2022-02-02 12:49:51

"The more the navigation controls, animations, and third-party libraries, the more it affects performance." React native app development does have performance issues. The guide determines solutions for common performance issues in React Native, focusing on memory leaks, size, navigation, etc., in apps. Both learners and professional programmers can inform themselves with the tricks provided or take help from expert app development companies.

Moving From Full-Stack Developer To Web3 Pioneer

Aggregated on: 2022-02-02 12:49:51

Last summer, my wife and I watched a program called “StartUp” on Netflix. The three-season series features the challenges faced by a cast of characters to create “GenCoin,” a new (and fictional) digital currency. As I watched the show, I wondered how my life would be different if I were a member of the engineering team driving GenCoin adoption. While products like GenCoin originated with the purpose of providing a new way to perform financial transactions, the underlying concepts are more powerful than just currency-related tasks. In fact, the distributed nature in how blockchain is designed ties directly to the heart of Web3.

Performance Evaluation of Python

Aggregated on: 2022-02-02 12:19:51

In a class, some students are multi-talented and score well in all the spheres- sports, academics, and debates. There are some students, who are only good in sports and not in academics. And we have a lot of students who are good at none. So where does this smart, handsome boy named- Python belong to? We need to evaluate the performance while looking at the different capabilities and accomplishments before making a performance card. So let's check the calculations.

How To Ensure Your Kubernetes Cloud OS Security

Aggregated on: 2022-02-02 11:19:48

The main feature of the Kubernetes cloud OS is that any module in the cluster can interact seamlessly with another module. Although the user gets unlimited access to useful platforms and new features at the same time, such a model is fraught with potential risks and vulnerabilities. In this regard, there are two radically different approaches to security: shift to the right and shift to the left, static and dynamic approach.

How Dangerous Is Log4Shell and How it Affects the Java Industry?

Aggregated on: 2022-02-02 10:49:48

In this short article, I would like to elaborate on the Log4Shell vulnerability and how it might affect the Java community. Log4Shell has been a hot topic in different media since its discovery. However, not all sources describe the problem correctly; some believe that it is a vulnerability reducing the whole Java world to a broken reed. To clear away all misinterpretations, Log4Shell is not a Java vulnerability, but a Java library Apache Log4j 2 bug. This widely spread Java software is designed for logging error messages in applications.

CockroachDB With Django and MIT Kerberos

Aggregated on: 2022-02-02 09:49:48

Today, I'm going to talk about the means of using Django with a kerberized CockroachDB and what that entails. This is not uncommon in a production use case and expecting enterprise-grade access to development frameworks is table stakes for some of our customers. Articles Covering CockroachDB and Kerberos I find the topic of Kerberos very interesting and my colleagues commonly refer to me for help with this complex topic. I am by no means an expert at Kerberos, I am however familiar enough with it to be dangerous. That said, I've written multiple articles on the topic which you may find below:

How to Test and Benchmark Database Clusters

Aggregated on: 2022-02-02 09:04:48

Benchmarking will help you fail fast and recover fast before it’s too late. Teams should always consider benchmarking as part of the acceptance procedure for any application. What is the overall user experience that you want to bake into the application itself? Ensure that you can support scaling your customer base without compromising user experience or the actual functionality of the app.

API Development Workflow With Python and Zato

Aggregated on: 2022-02-02 01:19:48

Zato is an integration platform and backend application server which means that, during most of their projects, developers using Zato are interested in a few specific matters. The platform concentrates on answering these key, everyday questions that Python backend developers routinely ask:

SimpleHTTPOperator in Apache Airflow

Aggregated on: 2022-02-02 00:49:48

Introduction The SimpleHTTPOperator is an Operator in Airflow which can be used to request an API, say any REST service, and get the response from the Service. This article covers the important aspects of using a SimpleHTTPOperator, such as: Where to configure the URL (http_conn_id) How to invoke a service How to parse the response back from the service Other attributes Let’s explore!

Pulumi With an Azure Blob Storage Backend

Aggregated on: 2022-02-02 00:34:48

By default when you use Pulumi, the state is managed by Pulumi Service which is very convenient as you can concentrate on building your project infrastructure instead of spending time on where to store the state and how to handle concurrency. However, sometimes for governance or pricing concerns, or any other reasons, you don't want to use Pulumi Service and you prefer to manage the state yourself with your own backend. In this article, we will see how we can do that using Azure. A Quick Reminder About States and Backends What Is This State We Need to Store? Like other Infrastructure as Code platforms, Pulumi uses a declarative approach:

Unboxing K8ssandra: The Data Layer For Your Kubernetes-Powered Applications

Aggregated on: 2022-02-02 00:34:48

Kubernetes made it easy to deploy and scale out your cloud-native applications. With K8ssandra, you can now scale application data with the same simplicity and high availability. Join us as we unbox K8ssandra a cloud native data layer for Kubernetes and explore how you can deploy it alongside your applications. Install k8ssandra Authenticate with Stargate Query your data via a convenient API (REST, document, or graphql) Not familiar with Cassandra? Astra DB is a great (free) place to learn without any of the infrastructure setup, or management headaches.

What Is Agile Methodology?

Aggregated on: 2022-02-01 23:04:48

Agile is a software development methodology where the product is delivered in increments that can be used and later be added on to, instead of one whole product after a long development cycle. The word agile means the ability to move quickly or easily, hence why it was chosen by the authors of the Agile Manifesto. The Agile Manifesto was a result of the need for a better software development methodology that will cover the gaps of existing development methods.

Adapter Design Pattern - Real-time Examples (Translator, Mobile Charger, Universal Adaptor, and More)

Aggregated on: 2022-02-01 19:49:48

In the video below, we take a closer look at Adapter Design patterns with Real-Time examples (translator, mobile charger, universal adaptor, etc.). Let's get started!

Platform Engineering With Pulumi (Part 3): Platform and Application Deployment With GitOps Automation

Aggregated on: 2022-02-01 16:49:48

In Episode 1 of this blog series, we built an AWS landing zone for our React/Node.js application, using Pulumi. In Episode 2 we built a simple React app and an Express API server. We manually deployed the app on the landing zone. In this episode, we will automate it with GitActions and CodeDeploy. For the sample application used in this blog, I have used Multi-repo. There is a huge debate on Mono vs Multi Repos. I might blog about that separately, but for now let's assume Multi repo is the best for this application and go ahead :-D.

The Real-time Web: Evolution of the User Experience

Aggregated on: 2022-02-01 15:49:48

Over the last few years, companies have used real-time updates to add new experiences and features and increase their market share. It's now standard to expect a page within an app or browser to update parts of itself without forcing it to refresh. For example, a news page of live sports scores updates with the latest goal scored, or an app shows a change as you track your taxi on a map.

How To Get Notified On New Helm Chart Release With Nova?

Aggregated on: 2022-02-01 15:49:48

Kubernetes is the most widely used orchestration platform in the world. This platform is becoming a standard in the DevOps world. His popularity has led to the emergence of many projects at different scales to facilitate and optimize the management of internal Kubernetes resources, Helm is a good example. Helm is the package manager of the Kubernetes universe. It is used by most of the DevOps community for its structuring and ease of YAML file templatization needed to define the Kubernetes resources to create. Like any package manager, It also facilitates the lifecycle of artifacts created by the simplicity of managing the versioning of these.

Dependency Management for C++ Using Maven and Nexus

Aggregated on: 2022-02-01 15:04:48

Check out GitHub. Choice of Maven I tried using Conan and found it overall good, but a bit disappointing. I used Conan on a project that needed development for a relatively short time, then it would sit for years with very little development. At some point, after the development sprint was done, the Jenkins builds started to fail because IT upgraded the server, part of which was upgrading Python applications that are installed via pip, that includes Conan. It turns out the upgraded Conan no longer worked with the build files we had.

The Flatten Maven Plugin

Aggregated on: 2022-02-01 15:04:48

One of the Apache Maven committers recently wrote about their plans for Maven 5. I consider the following one of the most significant changes: In summary, we need to make a distinction between two POM types:

Evolving Role of QA With Advancements in eLearning

Aggregated on: 2022-02-01 14:04:48

Over time, technology has evolved to provide better experiences and services to customers. Technological upgrades have impacted almost every sector, and the eLearning sector has also felt its effects. Earlier, we used to have classes for any course in person. Then, distance learning courses were introduced, and now we have digital training via eLearning using the latest technologies.