News AggregatorHow To Convert ODF Files to PDF in JavaAggregated on: 2023-11-06 20:33:31 When the time comes to pick and download a suite of office applications, we can expect that the MS Office suite will dominate the conversation. Each application included in the MS Office package comes equipped with dozens of powerful, intuitive features, and all the OpenXML file formats – .DOCX, .XLSX, PPTX, etc. – can shoulder the burden of immense, data-intensive edits and developer customizations while retaining a relatively small file size through efficient compartmentalization and lossless compression. However, OpenXML files aren’t the only ones represented in XML and zipped into convenient lossless file containers. The Apache OpenOffice suite – which originated in 2006, right around the timeframe when OpenXML format became standard for MS Office files – also offers XML-based file structure with lossless Zip compression, and this option makes for a nice alternative to OpenXML files when cost considerations come into play. View more...How To Master Advanced JSON Querying in SQLiteAggregated on: 2023-11-06 20:33:31 In the prior article, Learning the Basics: How to Use JSON in SQLite, we dived into SQLite's essential JSON functions and their capabilities. We explored the use of JSON as unstructured data within an SQLite database. Crucially, we detailed some of the necessary SQLite JSON functions, discussing their role in data storage and retrieval, followed by practical SQL query examples. This foundational understanding of how to work with JSON data in SQLite sets the stage for your advanced exploration of the topic. Let's get started! View more...LangChain in Action: Redefining Customer Experiences Through LLMsAggregated on: 2023-11-06 18:33:31 In our previous blog post, “Unraveling LLMs' Full Potential, One Token at a Time with Open-source Framework,” we delved into the innovative strides made by LangChain in reshaping the capabilities of Large Language Models (LLMs). LangChain, as an open-source framework, equips LLMs with the capacity to provide nuanced and expert-level responses, a feat that has the potential to redefine how we interact with information. However, in this installment, we’re diving even deeper into the practical applications of LangChain, particularly in the realm of customer support—a domain where personalized and informed interactions are paramount. View more...Bard: The New ChatGPT CompetitorAggregated on: 2023-11-06 18:33:31 In its constant quest to optimize the user experience in artificial intelligence, Google has introduced Bard, its latest and most advanced conversational system. This innovative tool not only promises to stay up-to-date thanks to its permanent connection to the Internet, distinguishing it from other systems such as ChatGPT, but it also seeks to revolutionize the way we interact with technology. From its ability to interpret and describe images to its promising integration with other leading services such as Gmail, Docs, and Google Lens, Bard is shaping up to be the central nexus in Google’s service ecosystem. Moreover, its collaboration with Adobe Firefly suggests a horizon where the generation and understanding of visual content reach unprecedented levels. Although still in an experimental phase, Bard promises to redefine the boundaries of what we expect from an AI system. View more...Exploring Lightweight Concurrency With Virtual Threads: A Developer-Agnostic PerspectiveAggregated on: 2023-11-06 18:18:31 As software applications grow in complexity, the need for efficient concurrency management becomes increasingly important. Traditional threading models can be resource-intensive and difficult to manage, especially when dealing with a large number of threads. This challenge has led to the development of virtual threads, a lightweight alternative that simplifies concurrent programming. In this article, we will explore the concept of virtual threads from a developer-agnostic perspective, discussing their benefits and potential use cases. While our examples will focus on Java 21 and Project Loom, the concepts discussed are applicable to other languages and platforms that support similar lightweight concurrency models. View more...Statistical Concepts Necessary for Data ScienceAggregated on: 2023-11-06 18:03:31 Data science is a rapidly growing field that combines statistics, computer science, and domain knowledge to extract insights from data. Statistical concepts play a fundamental role in data science, as they provide the tools and techniques for collecting, cleaning, analyzing, and interpreting data. This article will provide an overview of the key statistical concepts that data scientists need to know. It will cover both descriptive statistics and inferential statistics, as well as some more advanced topics such as probability distributions, hypothesis testing, and regression. View more...What Is a Conditional Generative Adversarial Network?Aggregated on: 2023-11-06 18:03:31 The rise of Generative Artificial Intelligence (GenAI) has introduced innovative services and cutting-edge tools to automate tasks, optimize processes, and speed up transactions. These benefits make it more enticing for businesses to deploy AI services for their expansion and growth strategies. One important technological breakthrough that has made this growth possible is the conditional generative adversarial network (CGAN). View more...Can We Measure Developer Productivity?Aggregated on: 2023-11-06 18:03:31 Can software developer productivity be measured? And if so, how do you measure it? Should you measure it? This is not just a general topic. This is actually really relevant right now. Why Is It Important Now? This topic has been all over the news lately. In case you didn't know, we're having a bit of an economic downturn. Some say recession, some just say slow period, and who knows what it is. But the point is, it's causing people to look at their finances. They're now looking at the productivity. View more...The Illusion of VelocityAggregated on: 2023-11-06 17:33:31 In this article, I explore the pitfalls of ‘The Illusion of Velocity’ in Agile contexts, peeling back the layers of traditional metrics as leadership tools. Moreover, I point to the advantages gained from leadership engaging directly with teams. Understand why servant leadership and practices like the Gemba Walks are crucial for coping with complex, adaptive environments toward actual progress. Moreover, get an idea of how to start flipping outdated hierarchies and embrace the natural rhythm of productivity and innovation. View more...Next.js vs. Express.js: What Are the Differences?Aggregated on: 2023-11-06 17:33:31 Businesses widely rely on JavaScript to develop web development projects that would help in enhancing efficiency and achieving goals. There has been incredible development in technology, and several frameworks are available, but choosing an appropriate one can be a challenge since each of them has specific functionality. Express.js and Next.js are the most advanced frameworks available for web development, and thus, we would like to highlight the features, pros, and cons of both frameworks to help businesses make a better choice. View more...Dockerizing ML Models: A Deployment GuideAggregated on: 2023-11-06 17:33:31 In the rapidly evolving domain of machine learning (ML), the ability to seamlessly package and deploy models is as crucial as the development of the models themselves. Containerization has emerged as the game-changing solution to this, offering a streamlined path from the local development environment to production. Docker, a leading platform in containerization, provides the tools necessary to encapsulate ML applications into portable and scalable containers. This article delves into the step-by-step process of containerizing a simple ML application with Docker, making it accessible to ML practitioners and enthusiasts alike. Whether you're looking to share your ML models with the world or seeking a more efficient deployment strategy, this tutorial is designed to equip you with the fundamental skills to transform your ML workflows using Docker. View more...The Journey of Becoming a Blockchain DeveloperAggregated on: 2023-11-06 16:03:31 Blockchain solutions are becoming more popular, signaling a rising demand for professionals who develop these systems. Just six to eight years ago, the role of a blockchain developer was relatively obscure. Today, you can find these professionals networking in dedicated communities, actively engaging in forums, and scouring job sites for the most attractive employers. In this article, I will explore what it takes to become a blockchain developer. While cryptocurrencies remain the most popular application of blockchain technology, their significance in the digital sphere has vastly broadened. Today, blockchain plays a crucial role in enhancing digital security, such as thwarting DDoS attacks and hacking attempts, by bolstering data protection in cloud storage via decentralized networks. It also revolutionizes advertising by directly connecting goods and services with consumers, bypassing the need for intermediaries. In the entertainment sector, blockchain technology presents new avenues for safeguarding artists' copyrights. In finance, it fortifies the security protocols of banking transactions. View more...Migrating Mulesoft System API to AWS Lambda (Part 1)Aggregated on: 2023-11-06 15:33:31 In this article, we will be discussing how to migrate a System API running in Mulesoft to AWS Lambda in a quick and efficient manner with the least effort. To start, let's understand what system API is in Mulesoft. What Is System API? System APIs provide access to data stored in an organization's central systems of record. They can extract information from essential systems such as ERP, customer, and billing databases, as well as proprietary data repositories. View more...The Inner Workings of Vision TransformersAggregated on: 2023-11-06 15:03:31 Transformers have become the model architecture of choice for many vision tasks. Vision Transformers (ViTs) are especially popular. They apply the transformer directly to sequences of image patches. ViTs now match or exceed CNNs on benchmarks like image classification. However, researchers from Meta and INRIA have identified some strange artifacts in the inner workings of ViTs. In this post, we'll do a deep dive into a new paper investigating the cause of these artifacts. And we'll see how researchers used a simple trick (not to sound too clickbait-y) to get models to focus on the subjects of images and not the boring background patches that tend to confuse them. Let's go. View more...The Power of Resource-Oriented Programming in Cadence: A Deep DiveAggregated on: 2023-11-06 15:03:31 Flow is a permissionless layer-1 blockchain built to support the high-scale use cases of games, virtual worlds, and the digital assets that power them. The blockchain was created by the team behind CryptoKitties, Dapper Labs, and NBA Top Shot. One of the best features of Flow is that it supports the paradigm of resource-oriented programming. Resource-oriented programming is a new way of managing memory where resources are held “in situ” by the resource owner instead of in a separate ledger. This is very relevant for managing scarce and unreplicable digital resources on the blockchain. View more...Using OceanBase To Build a Real-Time User Analytics PipelineAggregated on: 2023-11-06 15:03:31 In the digital era we live in, data is everywhere — it's collected from sources like web and mobile applications, IoT devices, social media interactions, and CRM systems. As a SaaS product owner myself, I've seen how this vast array of data sources can become overwhelming when it comes to user behavior analysis and visualization. The challenge is not just in collecting the data but also in managing and making sense of it. A solution I've found effective is setting up a centralized data processing pipeline. It involves collecting user data from various sources, storing it in a single database, and then analyzing and visualizing this data in real-time to provide insights into the product and how users are using the product. It's like having a one-stop shop for all your data needs, which can be extremely useful for decision-making processes. View more...Mocking API Response in CypressAggregated on: 2023-11-06 14:33:31 Mocking, in a broader software development and testing context, is a technique used to simulate the behavior of certain components or objects in a controlled manner. It involves creating fake or mock objects that imitate the behavior of real objects or components within a software system. Mocking is often used in various stages of software development, including testing, to isolate and focus on specific parts of a system while ignoring the complexities of its dependencies. Mocking allows developers and testers to isolate specific parts of a system for testing without relying on the actual implementation of external components, services, or modules. View more...Secure Your Web Applications With Facial AuthenticationAggregated on: 2023-11-06 14:03:31 For the last three decades, web technology has remained relevant due to its versatile nature and wide range of applications in building solutions. The web runs virtually everything, from simple blog sites to complex and scalable web-based ERP systems in B2B, gaming, and fintech, as well as other industries. In order to personalize the user experience in web applications, we need to authenticate them. Over the years, user authentication has evolved from 4-digit personal identification numbers (PINs) to multi-factor authentication. The latter requires users to provide additional data such as OTP codes, usually sent to their mobile number or emails, in addition to a username and password. View more...Optimize Your Web3 DevOps with User Feedback FormsAggregated on: 2023-11-06 12:03:31 While attending college, I worked part-time at a local recording studio to maintain my serious interest in the music industry. Since you’re reading this article in a publication unrelated to the music industry, it is easy to conclude that I parted ways with music since that time (well, aside from the creation of what I feel are some pretty impressive Spotify playlists). Some of my friends still work and thrive in the music industry, and it’s impressive to hear how things have changed over the years, especially on the recording side of the spectrum. The industry has continued to innovate, mostly because product manufacturers listened to feedback provided by those who depend on such tooling to create their art. This is no different than working in the tech industry today. Getting and listening to user feedback is critical to successful tech products. View more...TAO: A Comprehensive Look at Facebook's Distributed Data StoreAggregated on: 2023-11-05 17:48:31 As Facebook's user base and social graph complexity have expanded exponentially, the need for a highly scalable and efficient data storage solution has become increasingly critical. Enter TAO (The Associations and Objects), Facebook's custom-built distributed data store, designed to manage the social graph and provide low-latency access to user data. In this article, we will take an in-depth look at TAO, exploring its technical features, architecture, and the role it plays in optimizing Facebook's performance. TAO: A Graph-Based Data Model At its essence, TAO is an elegant and efficient graph-based data model that comprises two primary entities: objects and associations. Objects are nodes within the social graph, representing users, pages, posts, or comments. Associations, on the other hand, symbolize relationships between these objects, such as friendships, likes, or shares. View more...Practical Routes to Healthy CultureAggregated on: 2023-11-05 17:48:31 The recent release of the Accelerate State of DevOps Report has once again highlighted the value of organizational culture. If you create a generative culture with high trust and low blame, you'll receive a 30% boost to your organization's performance. Successfully updating the culture of a whole organization depends on its leader's passion, support, and attention span. At the ground level, when you pay attention to cultural signals, you'll find ways to make continuous small improvements. View more...Unleashing Linux Power on Windows: Exploring the WSL FeatureAggregated on: 2023-11-05 17:33:31 The Windows Subsystem for Linux (WSL), which unites the Windows and Linux operating systems, has completely changed how users and developers interact with these systems. WSL, which Microsoft first released in 2016, offers a compatibility layer for Windows that enables users to run native Linux command-line tools and applications on their Windows systems. A whole new world of opportunities has been made possible for both developers and enthusiasts by this potent feature, which has eliminated the gap between two historically separate operating systems. Microsoft revolutionized the relationship between Windows and Linux when it introduced the Windows Subsystem for Linux (WSL) feature. WSL brings the strength, adaptability, and extensive ecosystem of Linux to the Windows operating system by enabling developers and users to run a full-fledged Linux environment directly on Windows. Let us explore the world of WSL, including its advantages, applications, and how it has merged two different platforms. View more...18 Software Development Trends and Predictions 2024Aggregated on: 2023-11-03 18:48:30 The need for thorough risk assessments, continuous testing, and compliance checks before full-scale deployments is unavoidable. The future of software development demands businesses to be gearing up for a delicate dance between innovation and reliability. This year, we saw enthusiasm for AI/ML with the emergence of Generative AI and other such technologies. However, as the year comes to a conclusion, the key focus seems to have shifted to strike the right balance between efficiency and security. This dual imperative is a fundamental concern, emphasizing that responsible decision-making, privacy preservation, and ethical standards are paramount. Predictably, technologies that embody these principles will be favored in the global software development landscape. Therefore, our software development experts have studied the ongoing trends and made some predictions regarding the landscape for the coming year. Let us go through these predictions regarding software development for the year 2024. View more...Limited Conversations With Distributed SystemsAggregated on: 2023-11-03 18:03:30 By the way, ChatGPT suggested the title: The Art of Balancing Control and Accessibility Background Houston Airport had this really big problem. Passengers complained about the time it took for luggage to arrive at the terminal building after the airplane had landed. The Airport invested millions to solve this pain point. They improved the process, hired more people, and introduced new technology. They eventually succeeded in reducing the wait time to 7 minutes. However, users still complained. The Airport realized that they had reached a point where optimizing the process/design was no longer optimal. So they did something different. They reframed the problem. By reframing the problem, they discovered that it was not the time it took to get the luggage to the terminal building that was the problem. It was the time the passengers had to wait for the luggage that was the problem. The Airport decided to park the airplanes further away from the terminal building. Consequently, it took some time for passengers to arrive at the terminal building, thus reducing the wait time for luggage, and voila! Complaints dropped drastically. View more...Secrets Management Takes More Than Just ToolsAggregated on: 2023-11-03 16:48:30 Every company wants to have a good security posture, and most are investing in security tooling. According to Gartner, worldwide spending on security is forecast to grow 11.3% in 2023 to reach more than $188.3 billion. However, despite all this spending, there are certain areas where problems are only getting worse, such as secrets sprawl. Reports now say over 50% of cyber attackers gained their initial foothold by exploiting compromised credentials. No organization wants to go through an indecent like Samsung or Nvidia or repeat Uber's unfortunate experience. View more...Domain-Driven Design: Why Do Companies Need This Approach, Who Uses It, and What Is Its Essence?Aggregated on: 2023-11-03 16:48:30 Building software that meets the needs and expectations of businesses and users in a dynamic and ever-changing technological world can be challenging. Software companies gradually require a workable way to make communication between the business and the product team more transparent. The domain-driven design (DDD) approach helps to solve this problem by fostering a profound understanding of the subject matter and continuous collaboration between developers and business experts. In fact, developers gain a more in-depth understanding of the underlying domain and business rules through constant communication. At the same time, stakeholders gain a better understanding of technical capabilities and constraints. For example, Standish Group’s analysis of 100 projects found that 70% of rework was due to a lack of domain knowledge during the requirements and design phases, confirming that DDD fosters understanding between businesses and developers. View more...How to Leverage OAS and RAML in AWS API GatewayAggregated on: 2023-11-03 16:18:30 Do you have an OpenAPI Specification and don't know if it can be imported into Amazon API Gateway to avoid defining each resource by hand through the console? This article shows you how to leverage an existing OAS specification in API Gateway. If, on the other hand, you have a RAML specification, the article How to convert from RAML to OAS to use it in Amazon API Gateway offers a step-by-step guide to create your OpenAPI specification from an existing RAML. View more...Querydsl vs. JPA Criteria, Part 5: Maven IntegrationAggregated on: 2023-11-03 16:03:30 As most technologies or dependencies evolve fast, it's sometimes hard to make the initial setup or upgrade smoothly. The goal of this article is to provide a summary of the Maven setup for the Querydsl framework, depending on the used technology. After that, let's see a short overview of the Querydsl solution. In This Article, You Will Learn How to setup Querydsl with Spring Boot 2.x (i.e Java EE) and Spring Boot 3.x (i.e. Jakarta EE) What is a Maven classifier How is the Maven classifier used in Querydsl build Usage of Eclipse Transformer Plugin Querydsl Setup There are several possibilities to set up Querydsl framework in a Spring Boot application. The correct approach depends on the technologies used. View more...The State of Data Streaming for Energy and Utilities in 2023Aggregated on: 2023-11-03 15:48:30 This blog post explores the state of data streaming for the energy and utilities industry in 2023. The evolution of utility infrastructure, energy distribution, customer services, and new business models requires real-time end-to-end visibility, reliable and intuitive B2B and B2C communication, and integration with pioneering technologies like 5G for low latency or augmented reality for innovation. Data streaming allows integrating and correlating data in real-time at any scale to improve most workloads in the energy sector. I look at trends in the utilities sector to explore how data streaming helps as a business enabler, including customer stories from SunPower, 50hertz, Powerledger, and more. A complete slide deck and on-demand video recording are included. View more...LLM: Trust, but VerifyAggregated on: 2023-11-03 13:03:30 My most-used Gen AI trick is the summarization of web pages and documents. Combined with semantic search, summarization means I waste very little time searching for the words and ideas I need when I need them. Summarization has become so important that I now use it as I write to ensure that my key points show up in ML summaries. Unfortunately, it’s a double-edged sword: will reliance on deep learning lead to an embarrassing, expensive, or career-ending mistake because the summary missed something, or worse because the summary hallucinated? Fortunately, many years as a technology professional have taught me the value of risk management, and that is the topic of this article: identifying the risks of summarization and the (actually pretty easy) methods of mitigating the risks. View more...7 Query Strategies for Navigating Knowledge Graphs With NebulaGraph and LlamaIndexAggregated on: 2023-11-03 12:18:30 There has been a lot of buzz around developing RAG (Retrieval Augmented Generation) pipelines powered by LLMs and Knowledge Graphs (KG) lately. In this article, let’s take a close look at Knowledge Graphs by building an RAG pipeline for the Philadelphia Phillies using LlamaIndex and NebulaGraph. Use Case We will use Knowledge Graph, specifically the open source NebulaGraph, to query information on the Philadelphia Phillies, the Major League Baseball team based in Philadelphia. My whole family are big fans of the Phillies! View more...Maximize Your Analytics Potential With Server-Side Tracking and Google Analytics 4 IntegrationAggregated on: 2023-11-03 12:18:30 It is crucial to stay updated with the latest tracking techniques in the ever-evolving landscape of web analytics. The paradigm has shifted from client-side tracking to server-side tracking to ensure sensitive customer data is protected when it is being collected across multiple platforms. The major concern arises when data has to be processed and analyzed. This article will delve into the integration of server-side tagging with Google Analytics 4 (GA4) to explore the concept of cookie-less tracking. View more...Serverless Image Generation Application Using Generative AI on AWSAggregated on: 2023-11-03 11:48:30 Whether it's crafting personalized content or tailoring images to user preferences, the ability to generate visual assets based on a description is quite powerful. But text-to-image conversion typically involves deploying an end-to-end machine learning solution, which is quite resource-intensive. What if this capability was an API call away, thereby making the process simpler and more accessible for developers? This tutorial will walk you through how to use AWS CDK to deploy a Serverless image generation application implemented using AWS Lambda and Amazon Bedrock, which is a fully managed service that makes base models from Amazon and third-party model providers (such as Anthropic, Cohere, and more) accessible through an API. Developers can leverage leading foundation models through a single API while maintaining the flexibility to adopt new models in the future. View more...Generative AI Innovations Supercharge DevelopersAggregated on: 2023-11-03 11:48:30 At SAP TechEd 2023, SAP unveiled a series of generative AI capabilities to empower developers and make their workloads faster and easier. As Juergen Mueller, SAP's CTO, stated, "Today’s dynamic technology and business landscape means every developer needs to be an AI developer." SAP is meeting this need by launching tools and platforms infused with the power of AI, specifically tailored for developers across skill levels. View more...Hello YugabyteDB: Running Kong on the Distributed PostgreSQL DatabaseAggregated on: 2023-11-03 11:48:30 In my previous articles, we've discussed in detail how to architect global API layers and multi-region service meshes using Kong and YugabyteDB. However, the solutions presented still harbored a bottleneck and a single point of failure: the database Kong uses internally to store its metadata and application-specific configurations. This guide demonstrates how to eliminate this final bottleneck by running Kong on YugabyteDB, a distributed SQL database built on PostgreSQL. Kong's Default Database Kong uses PostgreSQL as a database for its own needs. Taking a look at the database schema created by Kong during the bootstrap process, you'll find dozens of tables and other database objects that store metadata and application-specific configurations: View more...Exploring AI's Contribution to Ethics and ESG in EnterprisesAggregated on: 2023-11-03 11:18:30 The incredible growth of artificial intelligence applications is due in no small part to the ever-increasing power of computers and their hardware, which today enables systems to be created and trained according to gigantic data volumes or CPU (or GPU) quantities, managing trillions of parameters. Beyond all the added value these technologies bring, it's important to be aware of and consider the challenges they represent. View more...JBang: How to Script With Java for Data Import From an APIAggregated on: 2023-11-03 11:18:30 It's right in the middle of the busy conference season, and I was prepping for an upcoming conference talk. As I often do, I went to Neo4j Aura to spin up a free database and use Cypher with APOC to import data from an API, but this API requires a header, and the APOC procedure that adds headers to a request is blocked by security in Aura. Hmm, I needed a new route. View more...Architecture Patterns: The Circuit-BreakerAggregated on: 2023-11-03 11:03:30 In the world of distributed systems, the likelihood of components failing or becoming unresponsive is higher compared to monolithic systems. Given the interdependence of microservices or modules in a distributed setup, the failure of one component can lead to cascading failures throughout the system, potentially causing the entire system to malfunction or shut down. Therefore, resilience — the ability of a system to handle and recover from failures — becomes critically important in distributed environments. Much like how an electrical circuit breaker prevents an overload by stopping the flow of electricity when excessive current is detected, the Circuit Breaker pattern in software engineering stops the flow of requests to a service when the number of failures exceeds a predefined threshold. This ensures that a failing service doesn’t continue receiving traffic until it recovers, preventing further strain and potential cascading failures. View more...Introducing Jira Security: Best Practices for Protecting Your DataAggregated on: 2023-11-02 20:48:29 There is no doubt that Jira is one of the most popular project management and issue-tracking tools for organizations. It provides a great number of benefits to teams, including improved collaboration between technical and non-technical teams, increased visibility, enhanced productivity, better project planning, flexible customization, scalability, comprehensive reposting, agile methodology support, and, of course, easy compatibility with other Atlassian cloud products — Bitbucket and Confluence. However, what would your team do if something went wrong with your Jira data? In this artice, we will have a deep dive into Jira security best practices. Yet, first, let’s have a quick tour of what security risks and threats your Jira data can face, and what security approaches Atlassian uses to protect your data against those threats. View more...How to Reduce LLM HallucinationAggregated on: 2023-11-02 20:03:29 LLM hallucination refers to the phenomenon where large language models like chatbots or computer vision systems generate nonsensical or inaccurate outputs that do not conform to real patterns or objects. These false AI outputs stem from various factors. Overfitting to limited or skewed training data is a major culprit. High model complexity also contributes, enabling the AI to perceive correlations that don't exist. Major companies developing generative AI systems are taking steps to address the problem of AI hallucinations, though some experts believe removing false outputs entirely may not be possible. View more...The Driving Force of Community at All Things Open 2023Aggregated on: 2023-11-02 20:03:29 I recently attended my second All Things Open conference and wanted to share some of the observations, experiences, and lessons I learned along the way. As conferences go, All Things Open stands out to me for a few reasons. Hosted at the Raleigh Convention Center in North Carolina, it’s one of the few larger shows that doesn’t sit in a wallet-busting city. And, at ~5,000 attendees, it’s definitely one of the more significant events, standing out from events like DevOpsDays, BSides, and even Monitorama, which attract much more modest crowds. And, of course, it stands out because of its focus. While every event — from the aforementioned DevOpsDays all the way up to the monster conferences like Cisco Live, VMware Explore, and re:Invent — contain an acknowledgment of the importance of open source tools, none of those events are so wholly and wholesomely focused on the tools, techniques, and community that make open source the powerful force for good that it is. View more...Garbage Collection Analysis: OpenJDK and GraalVMAggregated on: 2023-11-02 19:18:29 In this article, we are going to compare the performance of the Garbage Collection(GC) of OpenJDK and GraalVM. GraalVM is a popular open-source JVM implementation in Java with the capability to run applications as native images. Apart from that, it has got other functionalities such as fast loading time, compacted memory usage, etc. In this article, we will compare the garbage collection details of GraalVM and OpenJDK. View more...How To Convert From RAML to OAS To Use It in Amazon API GatewayAggregated on: 2023-11-02 18:48:29 Suppose you have an existing RAML specification to import into Amazon API Gateway for API definition. In that case, you won’t be able to use it as is since API Gateway does not support RAML specifications. This article will guide you step by step on creating a specification file with OpenAPI from scratch from an existing RAML specification. If you prefer not to manually convert your RAML specification into an Open API Specification (OAS). In that case, we have compiled a helpful list of tools to assist you in this conversion process. It's important to note that the complexity of your RAML may impact the accuracy of the translation performed by these tools. Therefore, it is crucial to review the resulting conversion for any inconsistencies and address them accordingly. View more...Streaming ESP32-CAM Images to Multiple Browsers via MQTTAggregated on: 2023-11-02 18:03:29 In this tutorial, you'll learn how to publish images from an ESP32-CAM board to multiple browser clients using MQTT (Message Queuing Telemetry Transport). This setup will enable you to create a platform that functions similarly to a live video stream, viewable by an unlimited number of users. Prerequisites Before diving in, make sure you have completed the following prerequisite tutorials: View more...Less Components, Higher PerformanceAggregated on: 2023-11-02 18:03:29 This post is about building a unified OLAP platform. An insurance company tries to build a data warehouse that can undertake all its customer-facing, analyst-facing, and management-facing data analysis workloads. The main tasks include: Self-service insurance contract query: This is for insurance customers to check their contract details by their contract ID. It should also support filters such as coverage period, insurance types, and claim amount. Multi-dimensional analysis: Analysts develop their reports based on different data dimensions as they need so they can extract insights to facilitate product innovation and their anti-fraud efforts. Dashboarding: This is to create a visual overview of the insurance sales trends and the horizontal and vertical comparison of different metrics. Component-Heavy Data Architecture The user started with Lambda architecture, splitting their data pipeline into a batch processing link and a stream processing link. For real-time data streaming, they apply Flink CDC; for batch import, they incorporate Sqoop, Python, and DataX to build their own data integration tool named Hisen. View more...Implementing Real-Time Datadog Monitoring in DeploymentsAggregated on: 2023-11-02 18:03:29 In today's tech landscape, where application systems are numerous and complex, real-time monitoring during deployments has transitioned from being a luxury to an absolute necessity. Ensuring that all the components of an application are functioning as expected during and immediately after deployment while also keeping an eye on essential application metrics is paramount to the health and functionality of any software application. This is where Datadog steps in — a leading monitoring and analytics platform that brings visibility into every part of the infrastructure, from front-end apps to the underlying hardware. In tandem with this is Ansible, a robust tool for automation, particularly in deployment and configuration management. In this article, we will discover how Datadog real-time monitoring can be integrated into Ansible-based deployments and how this integration can be leveraged during deployments. This concept and methodology can be applied to similar sets of monitoring and deployment tools as well. Why Integrate Real-Time Monitoring in Deployments? In the ever-evolving realm of DevOps, the line between development and operations is continuously blurring. This integration drives a growing need for continuous oversight throughout the entire lifecycle of an application, not just post-deployment. Here's why integrating Datadog with your deployment processes and within your deployment scripts is both timely and essential: View more...Useful Sensors Launches AI in a BoxAggregated on: 2023-11-02 17:48:29 Would you leave a Google Staff Research Engineer role just because you want your TV to automatically pause when you get up to get a cup of tea? Actually, how is that even relevant, you might ask. Let’s see what Pete Warden, former Google Staff Research Engineer and now CEO and Founder of Useful Sensors, has to say about that. From Jetpac To Google and TinyML, From Google To AI in a Box Pete Warden wrote the world’s only mustache detection image processing algorithm. He also was the founder and CTO of startup Jetpac. He raised a Series A from Khosla Ventures, built a technical team, and created a unique data product that analyzed the pixel data of over 140 million photos from Instagram and turned them into in-depth guides for more than 5,000 cities around the world. View more...On Type Safety in LangChain TSAggregated on: 2023-11-02 17:48:29 At Octomind, we are using Large Language Models (LLMs) to interact with web app UIs and extract test case steps that we want to generate. We use the LangChain library to build interaction chains with LLMs. The LLM receives a task prompt, and we, as developers, provide tools the model can utilize to solve the task. The unpredictable and non-deterministic nature of the LLM output makes ensuring type safety quite a challenge. LangChain's approach to parsing input and handling errors often leads to unexpected and inconsistent outcomes within the type system. I’d like to share what I learned about parsing and error handling of LangChain. View more...Launching Your Career in Tech: A Novice Developer’s GuideAggregated on: 2023-11-02 17:18:29 The tech industry has a lot to offer, from good pay and remote work options to a warm welcome in the professional community. People of all ages are drawn to it. This article explores how to become a developer efficiently and move up in your career quickly. I've gathered knowledge from experienced professionals and various sources, along with the experiences of colleagues who have achieved great results. I won't promote specific courses, but you can easily find effective ones based on their descriptions. For someone without a computer science background, starting to learn programming can be overwhelming. You'll encounter many unfamiliar terms and need to make decisions about specialization and programming languages. Choosing the right educational programs, courses, and creating a development plan is just the beginning. After you've mastered the basics, you'll need to dive into the technologies surrounding your chosen language, a challenge even experienced programmers face as it involves a lot of knowledge that can vary from project to project. View more...AWS Resources To Help You Get Started in the Cloud JourneyAggregated on: 2023-11-02 16:48:29 Since the time AWS was introduced in 2002, the Cloud Platforms have both increased in number and have also matured in terms of the services that they offer. The cloud providers each have over 100 services. As these Cloud platforms continue to mature, the wealth of information that is available for someone to consume has also grown considerably and continues to grow. This can be overwhelming for someone who wants to build their career on Cloud, to even know where to start and how to go about learning and building on cloud skills. It also becomes challenging to balance work and learning for many of the cloud aspirants. Add to that, costly training, seeking approvals, and getting on waiting lists are enough to kill the enthusiasm for many. If you are one of those folks who is just getting started on the AWS Cloud, the blog lists the free resources that will make your journey much easier. Read on… View more... |
|
|