Difference between revisions of "Point Cloud"

From
Jump to: navigation, search
m
 
(27 intermediate revisions by the same user not shown)
Line 2: Line 2:
 
|title=PRIMO.ai
 
|title=PRIMO.ai
 
|titlemode=append
 
|titlemode=append
|keywords=artificial, intelligence, machine, learning, models, algorithms, data, singularity, moonshot, Tensorflow, Google, Nvidia, Microsoft, Azure, Amazon, AWS  
+
|keywords=ChatGPT, artificial, intelligence, machine, learning, GPT-4, GPT-5, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Bard, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools
|description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools  
+
 
 +
<!-- Google tag (gtag.js) -->
 +
<script async src="https://www.googletagmanager.com/gtag/js?id=G-4GCWLBVJ7T"></script>
 +
<script>
 +
  window.dataLayer = window.dataLayer || [];
 +
  function gtag(){dataLayer.push(arguments);}
 +
  gtag('js', new Date());
 +
 
 +
  gtag('config', 'G-4GCWLBVJ7T');
 +
</script>
 
}}
 
}}
 
[http://www.youtube.com/results?search_query=Point+Cloud+Convolutional+Neural+Network+CNN+deep+machine+learning+ML Youtube search...]
 
[http://www.youtube.com/results?search_query=Point+Cloud+Convolutional+Neural+Network+CNN+deep+machine+learning+ML Youtube search...]
 
[http://www.google.com/search?q=Point+Cloud+Convolutional+Neural+Network+CNN+deep+machine+learning+ML ...Google search]
 
[http://www.google.com/search?q=Point+Cloud+Convolutional+Neural+Network+CNN+deep+machine+learning+ML ...Google search]
  
 +
* [[Robotics]] ... [[Transportation (Autonomous Vehicles)|Vehicles]] ... [[Autonomous Drones|Drones]] ... [[3D Model]] ... [[Point Cloud]]
 +
* [[Simulation]] ... [[Simulated Environment Learning]] ... [[World Models]] ... [[Minecraft]]: [[Minecraft#Voyager|Voyager]]
 +
** [[3D Model#3DCNN | 3DCNN]]
 +
* [[Hyperdimensional Computing (HDC)]]
 
* [http://www.qwertee.io/blog/deep-learning-with-point-clouds/ Deep learning with point clouds | Romain Thalineau - qwertee.io]
 
* [http://www.qwertee.io/blog/deep-learning-with-point-clouds/ Deep learning with point clouds | Romain Thalineau - qwertee.io]
* [http://arxiv.org/pdf/1904.07601.pdf RS-CNN: Relation-Shape Convolutional Neural Network for Point Cloud Analysis | Y. Liu, B. Fin, S. Xiang, and C. Pan - University of Chinese Academy of Sciences]
+
* [http://arxiv.org/pdf/1904.07601.pdf RS-CNN: Relation-Shape Convolutional Neural Network for Point Cloud Analysis | Y. Liu, B. Fin, S. Xiang, and C. Pan - University of [[Government Services#China|Chinese]] Academy of Sciences]
 
* [http://pointclouds.org/ Point Cloud Library (PCL)] is a standalone, large scale, open project for 2D/3D image and point cloud processing.
 
* [http://pointclouds.org/ Point Cloud Library (PCL)] is a standalone, large scale, open project for 2D/3D image and point cloud processing.
* [[Screening; Passenger, Luggage, & Cargo]]
+
* [[Cybersecurity]] ... [[Open-Source Intelligence - OSINT |OSINT]] ... [[Cybersecurity Frameworks, Architectures & Roadmaps | Frameworks]] ... [[Cybersecurity References|References]] ... [[Offense - Adversarial Threats/Attacks| Offense]] ... [[National Institute of Standards and Technology (NIST)|NIST]] ... [[U.S. Department of Homeland Security (DHS)| DHS]] ... [[Screening; Passenger, Luggage, & Cargo|Screening]] ... [[Law Enforcement]] ... [[Government Services|Government]] ... [[Defense]] ... [[Joint Capabilities Integration and Development System (JCIDS)#Cybersecurity & Acquisition Lifecycle Integration| Lifecycle Integration]] ... [[Cybersecurity Companies/Products|Products]] ... [[Cybersecurity: Evaluating & Selling|Evaluating]]
* [[3D Model]] e.g. [[3D Model#3DCNN | 3DCNN]]
 
 
* [[Graph Convolutional Network (GCN), Graph Neural Networks (Graph Nets), Geometric Deep Learning]]
 
* [[Graph Convolutional Network (GCN), Graph Neural Networks (Graph Nets), Geometric Deep Learning]]
 
* [http://info.vercator.com/blog/what-are-the-most-common-3d-point-cloud-file-formats-and-how-to-solve-interoperability-issues Common 3D point cloud file formats & solving interoperability issues | Charles Thomson - Vercator]
 
* [http://info.vercator.com/blog/what-are-the-most-common-3d-point-cloud-file-formats-and-how-to-solve-interoperability-issues Common 3D point cloud file formats & solving interoperability issues | Charles Thomson - Vercator]
Line 20: Line 32:
 
Although Convolutional Neural Networks are the state of the art techniques for 2D object detection, they do not perform well on 3D point cloud due to the sparse sensor data, therefore new techniques are needed. [http://medium.com/@SmartLabAI/3d-object-detection-from-lidar-data-with-deep-learning-95f6d400399a 3D Object Detection from LiDAR Data with Deep Learning | SmartLab AI - Medium]
 
Although Convolutional Neural Networks are the state of the art techniques for 2D object detection, they do not perform well on 3D point cloud due to the sparse sensor data, therefore new techniques are needed. [http://medium.com/@SmartLabAI/3d-object-detection-from-lidar-data-with-deep-learning-95f6d400399a 3D Object Detection from LiDAR Data with Deep Learning | SmartLab AI - Medium]
  
http://upload.wikimedia.org/wikipedia/commons/thumb/4/4c/Point_cloud_torus.gif/220px-Point_cloud_torus.gif
+
<img src="http://upload.wikimedia.org/wikipedia/commons/thumb/4/4c/Point_cloud_torus.gif/220px-Point_cloud_torus.gif" width="400" height="400">
 +
 
  
 +
<youtube>PL6wD8jczkE</youtube>
 
<youtube>KHYnC6t0boQ</youtube>
 
<youtube>KHYnC6t0boQ</youtube>
 
<youtube>pV-4xtirZCc</youtube>
 
<youtube>pV-4xtirZCc</youtube>
 
<youtube>Jz2jXect_7I</youtube>
 
<youtube>Jz2jXect_7I</youtube>
 +
<youtube>XkbauvReJFA</youtube>
 +
<youtube>VRIVeq6RWA8</youtube>
 +
  
 
== SPLATNet ==
 
== SPLATNet ==
Line 30: Line 47:
 
<youtube>rKL7cmJP0bg</youtube>
 
<youtube>rKL7cmJP0bg</youtube>
  
http://news.developer.nvidia.com/wp-content/uploads/2018/06/splatnet.png
+
<img src="http://news.developer.nvidia.com/wp-content/uploads/2018/06/splatnet.png" width="1000" height="600">
  
 
== [http://github.com/charlesq34/pointnet PointNet]  ==
 
== [http://github.com/charlesq34/pointnet PointNet]  ==
Line 37: Line 54:
 
<youtube>Cge-hot0Oc0</youtube>
 
<youtube>Cge-hot0Oc0</youtube>
  
http://www-cdn.qwertee.io/media/uploads/blog/deep_learning_with_point_clouds/pointnet_architecture.png
 
  
http://stanford.edu/~rqi/pointnet2/images/pnpp.jpg
+
<img src="http://www-cdn.qwertee.io/media/uploads/blog/deep_learning_with_point_clouds/pointnet_architecture.png" width="1000" height="700">
 +
 
 +
<img src="http://stanford.edu/~rqi/pointnet2/images/pnpp.jpg" width="1000" height="700">
 +
 
  
  
 
== [http://arxiv.org/abs/1609.06666 Vote3Deep] ==
 
== [http://arxiv.org/abs/1609.06666 Vote3Deep] ==
* [http://github.com/lijiannuist/Vote3Deep_lidar  Vote3Deep LIDAR]
+
* [http://github.com/lijiannuist/Vote3Deep_lidar  Vote3Deep LiDAR]
  
 
<youtube>WUOSmAfeXIw</youtube>
 
<youtube>WUOSmAfeXIw</youtube>
 +
 +
== Point-GNN ==
 +
a graph neural network to detect objects from a [[3D Model#LiDAR|LiDAR]] point cloud. Towards this end, we encode the point cloud efficiently in a fixed radius near-neighbors graph. We design a graph neural network, named Point-GNN, to predict the category and shape of the object that each vertex in the graph belongs to. In Point-GNN, we propose an auto-registration mechanism to reduce translation variance, and also design a box merging and scoring operation to combine detections from multiple vertices accurately. Our experiments on the KITTI benchmark show the proposed approach achieves leading accuracy using the point cloud alone and can even surpass fusion-based algorithms. Our results demonstrate the potential of using the graph neural network as a new approach for 3D object detection. [http://github.com/WeijingShi/Point-GNN | Weijing Shi and Raj Rajkumar - GitHub]
 +
 +
<youtube>jBowq7ubCtg</youtube>
  
 
== [http://github.com/BichenWuUCB/SqueezeSeg  SqueezeSeg] ==
 
== [http://github.com/BichenWuUCB/SqueezeSeg  SqueezeSeg] ==
 
<youtube>Xyn5Zd3lm6s</youtube>
 
<youtube>Xyn5Zd3lm6s</youtube>
 +
 +
== Neural Point-Based Graphics ==
 +
* [http://arxiv.org/abs/1906.08240 Neural Point-Based Graphics | Kara-Ali Aliev, Dmitry Ulyanov, and Victor Lempitsky]
 +
 +
<youtube>lbObxT7lJrI</youtube>
 +
<youtube>7s3BYGok7wU</youtube>
 +
 +
== Kd-Networks ==
 +
* [http://arxiv.org/pdf/1704.01222.pdf Escape from Cells: Deep Kd-Networks for the Recognition of 3D Point Cloud Models | Roman Klokov and Victor Lempitsky] ... [http://github.com/Regenerator/kdnets GitHub] This code uses python2.7 with theano(0.9.0) installed over Cuda8.0 with CuDNN5.1 and Lasagne(0.2.dev1).
 +
 +
<youtube>6UV_ASKa2RM</youtube>
 +
 +
 +
== Vote3Deep ==
 +
Fast Object Detection in 3D Point Clouds Using Efficient Convolutional Neural Networks
 +
 +
<youtube>WUOSmAfeXIw</youtube>
 +
 +
== 3D Point Cloud Classification, Segmentation and Normal estimation ==
 +
using Modified Fisher Vector and [[(Deep) Convolutional Neural Network (DCNN/CNN)|CNN]]s
 +
* [http://arxiv.org/pdf/1711.08241.pdf 3DmFV: Three-Dimensional Point Cloud Classification in Real-Time Using Convolutional Neural Networks | Y. Ben-Shabat, M. Lindenbaum, and A. Fischer
 +
 +
<youtube>PSVmTDzXPpc</youtube>
 +
 +
=== Modified Fisher Vector (3DmFV) ===
 +
* [http://www.itzikbs.com/what-is-3d-modified-fisher-vector-3dmfv-representation-for-3d-point-clouds What Is 3D Modified Fisher Vector (3DMFV) Representation For 3D Point Clouds | Itzik Ben Shabat]
 +
 +
http://i1.wp.com/www.itzikbs.com/wp-content/uploads/2018/09/3d_fv_smaller-compressor.gif
 +
 +
<youtube>HIUGOKSLTcE</youtube>

Latest revision as of 08:07, 16 June 2024

Youtube search... ...Google search

A point cloud is a set of data points in space. Point clouds are generally produced by 3D scanners, which measure a large number of points on the external surfaces of objects around them. As the output of 3D scanning processes, point clouds are used for many purposes, including to create 3D CAD models for manufactured parts, for metrology and quality inspection, and for a multitude of visualization, animation, rendering and mass customization applications. [A point cloud is a set of data points in space. Point clouds are generally produced by 3D scanners, which measure a large number of points on the external surfaces of objects around them. As the output of 3D scanning processes, point clouds are used for many purposes, including to create 3D CAD models for manufactured parts, for metrology and quality inspection, and for a multitude of visualization, animation, rendering and mass customization applications. Point Cloud and List of programs for Point Cloud processing | Wikipedia

Although Convolutional Neural Networks are the state of the art techniques for 2D object detection, they do not perform well on 3D point cloud due to the sparse sensor data, therefore new techniques are needed. 3D Object Detection from LiDAR Data with Deep Learning | SmartLab AI - Medium



SPLATNet

PointNet



Vote3Deep

Point-GNN

a graph neural network to detect objects from a LiDAR point cloud. Towards this end, we encode the point cloud efficiently in a fixed radius near-neighbors graph. We design a graph neural network, named Point-GNN, to predict the category and shape of the object that each vertex in the graph belongs to. In Point-GNN, we propose an auto-registration mechanism to reduce translation variance, and also design a box merging and scoring operation to combine detections from multiple vertices accurately. Our experiments on the KITTI benchmark show the proposed approach achieves leading accuracy using the point cloud alone and can even surpass fusion-based algorithms. Our results demonstrate the potential of using the graph neural network as a new approach for 3D object detection. | Weijing Shi and Raj Rajkumar - GitHub

SqueezeSeg

Neural Point-Based Graphics

Kd-Networks


Vote3Deep

Fast Object Detection in 3D Point Clouds Using Efficient Convolutional Neural Networks

3D Point Cloud Classification, Segmentation and Normal estimation

using Modified Fisher Vector and CNNs

  • [http://arxiv.org/pdf/1711.08241.pdf 3DmFV: Three-Dimensional Point Cloud Classification in Real-Time Using Convolutional Neural Networks | Y. Ben-Shabat, M. Lindenbaum, and A. Fischer

Modified Fisher Vector (3DmFV)

3d_fv_smaller-compressor.gif