DFIR Blog
  • Infosec
    • Blog
    • Threat Landscape
  • Digital Forensics
    • Windows Forensics
    • Mac Forensics
    • Memory Forensics
    • Forensic Resources
  • Incident Response
  • CISSP
    • Domain-1
    • Domain-2
    • Domain-3
    • Domain-4
    • Domain-5
    • Domain-6
    • Domain-7
    • Domain-8
  • Contact
  • HTB
  • Productivity

Blog

Components of Hadoop Distributed file System (HDFS)

2/18/2018

 

  • HDFS is a spread across multiple machines (Simple with commodity Hardware)
  • Nothing unique about individual machine but unique part is a cluster as a whole is highly fault tolerant 
  • Well Suited for large Batch Jobs
  • Not a low latency system
  • Data is HDFS is very very large (Semi-Structured)
  • Any data in HDFS in split across multiple disks where each disk in present on a diff machine in a cluster
  • File system manage machine and space
  • Setup by Master-Salve Nodes
  • Master Node (Name Node) coordinates with Slave Nodes(Data Node)
  • One Namenode/Cluster
  • For Example - Name note is like a table of content of a book and data node are the actual chapters
  • NameNode has 2 responsibilities 
    • Manage the overall file system
    • Stores (Directory Structure)
    • Other File metadata
  • DataNode
    • Physically stores the data 

Common SQL Functions

7/26/2015

 
Core aggregate functions like SUM, COUNT, MAX, MIN
Ranking functions like ROWNUM, RANK, NTILE
String functions like SUBSTR, REPLACE,INSTR
Data conversion functions like CAST, CONVERT

Useful SQL Queries

3/27/2015

 
Find Current database location
SELECT name, physical_name AS current_file_location
FROM sys.master_files

    Mac Forensics
    Windows Forensics
    Forensic Tools

    Categories

    All
    Attack
    Bash
    Bigdata
    Corporate
    Ctf
    Data
    Digital Forensics
    Docker
    EDR
    Forensics
    Hacking
    Hadoop
    HDFS
    Health Care
    Linux
    Memory
    Network
    Network Forensics
    PCIP
    SQL
    Windows
    Wireshark

    Archives

    October 2019
    September 2019
    July 2019
    June 2019
    May 2019
    March 2019
    April 2018
    March 2018
    February 2018
    July 2017
    June 2017
    May 2017
    November 2015
    October 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015

    RSS Feed

  • Infosec
    • Blog
    • Threat Landscape
  • Digital Forensics
    • Windows Forensics
    • Mac Forensics
    • Memory Forensics
    • Forensic Resources
  • Incident Response
  • CISSP
    • Domain-1
    • Domain-2
    • Domain-3
    • Domain-4
    • Domain-5
    • Domain-6
    • Domain-7
    • Domain-8
  • Contact
  • HTB
  • Productivity